Jul 03 09:43:15.722019 ip-10-0-138-110 systemd[1]: Starting Kubernetes Kubelet...
Jul 03 09:43:16.097068 ip-10-0-138-110 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 09:43:16.097068 ip-10-0-138-110 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 03 09:43:16.097068 ip-10-0-138-110 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 09:43:16.097068 ip-10-0-138-110 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 03 09:43:16.097068 ip-10-0-138-110 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 09:43:16.098679 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.098559    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 03 09:43:16.102754 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102740    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:16.102754 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102754    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102758    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102762    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102765    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102768    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102771    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102774    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102777    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102779    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102782    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102785    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102788    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102790    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102793    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102795    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102798    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102801    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102807    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102810    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102812    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:16.102815 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102815    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102818    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102821    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102823    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102826    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102829    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102831    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102834    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102836    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102839    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102841    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102843    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102846    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102849    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102853    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102857    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102860    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102863    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102865    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102868    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:16.103293 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102871    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102873    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102876    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102878    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102882    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102884    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102886    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102889    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102891    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102894    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102897    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102899    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102902    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102905    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102908    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102911    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102914    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102916    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102920    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102922    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:16.103865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102925    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102927    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102930    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102933    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102935    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102938    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102940    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102943    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102946    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102948    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102951    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102954    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102956    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102959    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102961    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102964    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102966    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102969    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102971    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102974    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:16.104557 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102976    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102979    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102981    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102984    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102987    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102990    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102995    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.102999    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103002    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103005    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103008    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103011    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103014    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103017    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103020    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103024    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103028    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:16.105057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.103031    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:16.106152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106135    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:16.106152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106150    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:16.106152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106154    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:16.106152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106157    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106160    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106164    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106167    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106170    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106172    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106175    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106179    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106182    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106185    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106188    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106190    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106193    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106196    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106199    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106201    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106204    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106206    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106209    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106211    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:16.106288 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106214    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106216    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106218    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106221    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106225    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106229    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106232    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106235    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106238    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106241    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106244    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106246    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106249    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106251    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106256    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106259    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106261    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106264    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106266    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106269    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:16.106798 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106272    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106274    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106277    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106280    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106282    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106286    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106288    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106291    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106293    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106296    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106299    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106302    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106305    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106307    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106310    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106312    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106315    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106317    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106319    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106322    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:16.107307 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106324    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106327    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106329    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106332    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106334    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106337    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106340    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106343    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106346    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106349    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106351    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106354    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106356    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106358    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106361    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106364    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106369    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106373    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106376    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:16.107803 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106379    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106384    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106388    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106391    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106394    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106397    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106400    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106402    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106405    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106408    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106410    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106413    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106416    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106418    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106421    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106423    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106426    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106814    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106819    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106823    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:16.108262 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106825    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106828    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106831    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106833    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106836    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106838    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106841    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106843    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106846    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106849    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106851    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106853    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106856    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106859    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106862    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106864    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106867    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106870    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106873    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106875    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:16.108750 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106878    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106880    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106883    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106885    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106888    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106892    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106896    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106899    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106901    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106905    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106908    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106911    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106913    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106916    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106919    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106922    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106924    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106927    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106929    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:16.109229 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106932    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106934    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106937    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106940    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106944    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106947    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106949    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106952    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106956    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106959    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106961    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106964    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106966    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106969    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106971    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106974    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106976    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106979    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106981    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:16.109693 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106984    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106986    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106989    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106991    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106994    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106996    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.106999    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107001    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107004    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107006    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107009    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107011    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107014    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107016    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107019    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107021    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107024    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107026    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107028    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107031    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:16.110172 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107033    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107036    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107042    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107045    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107049    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107051    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107054    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107057    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107060    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107063    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107065    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107068    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107070    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107073    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107075    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107079    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107082    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107084    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107157    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107163    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 03 09:43:16.110644 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107170    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107183    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107186    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107190    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107193    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107197    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107200    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107203    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107206    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107209    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107212    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107215    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107219    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107222    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107228    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107231    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107234    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107237    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107240    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107243    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107246    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107254    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107257    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 03 09:43:16.111171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107260    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107263    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107266    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107269    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107271    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107274    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107279    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107285    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107288    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107291    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107294    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107297    2580 flags.go:64] FLAG: --enable-server="true"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107299    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107304    2580 flags.go:64] FLAG: --event-burst="100"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107307    2580 flags.go:64] FLAG: --event-qps="50"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107310    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107313    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107316    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107320    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107323    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107326    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107329    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107332    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107336    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107340    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 03 09:43:16.111765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107343    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107345    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107348    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107351    2580 flags.go:64] FLAG: --feature-gates=""
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107355    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107358    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107360    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107363    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107366    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107369    2580 flags.go:64] FLAG: --help="false"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107372    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107375    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107377    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107382    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107386    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107389    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107392    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107394    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107397    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107400    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107402    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107405    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107408    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107411    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 03 09:43:16.112433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107414    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107417    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107419    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107422    2580 flags.go:64] FLAG: --lock-file=""
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107425    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107428    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107432    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107437    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107440    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107443    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107446    2580 flags.go:64] FLAG: --logging-format="text"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107448    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107452    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107454    2580 flags.go:64] FLAG: --manifest-url=""
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107457    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107461    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107464    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107468    2580 flags.go:64] FLAG: --max-pods="110"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107470    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107473    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107476    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107481    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107483    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107486    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107489    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 03 09:43:16.113033 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107496    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107499    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107502    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107505    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107508    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107513    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107516    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107518    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107521    2580 flags.go:64] FLAG: --port="10250"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107524    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107527    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d999dfdf1557a4e5"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107530    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107533    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107537    2580 flags.go:64] FLAG: --register-node="true"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107540    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107544    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107547    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107550    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107552    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107556    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107559    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107562    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107564    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107567    2580 flags.go:64] FLAG: --runonce="false"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107570    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 03 09:43:16.113660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107573    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107576    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107579    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107582    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107586    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107588    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107591    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107594    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107597    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107599    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107602    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107605    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107608    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107610    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107616    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107619    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107621    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107625    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107627    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107630    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107634    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107637    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107640    2580 flags.go:64] FLAG: --v="2"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107643    2580 flags.go:64] FLAG: --version="false"
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107648    2580 flags.go:64] FLAG: --vmodule=""
Jul 03 09:43:16.114268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107652    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.107655    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107781    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107786    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107789    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107792    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107795    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107797    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107800    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107802    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107805    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107809    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107812    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107815    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107818    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107821    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107823    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107826    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107828    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107831    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:16.114888 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107833    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107836    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107838    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107841    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107843    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107846    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107849    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107852    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107854    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107857    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107859    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107862    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107866    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107869    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107872    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107875    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107877    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107880    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107882    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107885    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:16.115363 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107887    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107890    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107892    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107897    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107899    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107902    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107905    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107907    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107910    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107913    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107915    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107918    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107921    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107923    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107926    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107928    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107931    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107933    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107936    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107939    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:16.115901 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107941    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107945    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107948    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107951    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107954    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107963    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107965    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107968    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107970    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107973    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107976    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107978    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107982    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107985    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107988    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107992    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107995    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.107998    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108000    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:16.116392 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108003    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108005    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108008    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108010    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108013    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108015    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108018    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108020    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108023    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108026    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108028    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108031    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108034    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108036    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108039    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108041    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108044    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108046    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108049    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108057    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:16.116865 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108060    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.108062    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.108638    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.115647    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.115662    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.115675    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.115684    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115753    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115759    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115763    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115766    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115769    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115772    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115776    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115780    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:16.117336 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115784    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115787    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115789    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115792    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115795    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115798    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115801    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115804    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115807    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115809    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115812    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115815    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115817    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115820    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115823    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115825    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115828    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115830    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115833    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115835    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:16.117717 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115839    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115843    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115847    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115851    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115855    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115857    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115861    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115863    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115866    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115869    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115871    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115873    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115876    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115879    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115881    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115884    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115886    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115888    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115891    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115894    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:16.118215 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115897    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115900    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115902    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115905    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115908    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115911    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115914    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115916    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115919    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115921    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115924    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115926    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115929    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115932    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115934    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115937    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115940    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115942    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115945    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115948    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:16.118685 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115950    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115953    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115955    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115958    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115960    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115963    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115966    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115968    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115971    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115973    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115976    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115978    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115981    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115984    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115986    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115989    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115991    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115994    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115996    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:16.119280 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.115998    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116001    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116003    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116006    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116008    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116011    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116013    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116016    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116018    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116021    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116024    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116027    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.116032    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116147    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116151    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:16.119743 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116154    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116157    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116160    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116169    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116173    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116175    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116178    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116181    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116184    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116186    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116189    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116192    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116194    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116197    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116199    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116202    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116204    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116207    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116209    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116212    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116214    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:16.120104 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116217    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116219    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116222    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116224    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116227    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116231    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116236    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116239    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116243    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116247    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116249    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116252    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116255    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116257    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116260    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116262    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116265    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116267    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116270    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:16.120624 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116272    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116275    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116277    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116280    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116283    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116285    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116287    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116290    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116293    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116295    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116297    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116300    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116303    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116305    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116308    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116310    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116313    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116316    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116320    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:16.121152 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116323    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116326    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116329    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116332    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116335    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116337    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116340    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116343    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116346    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116348    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116351    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116354    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116357    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116359    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116362    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116364    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116366    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116369    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116372    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116374    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:16.121595 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116377    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116379    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116382    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116384    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116386    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116389    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116391    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116395    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116397    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116400    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116402    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116405    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116410    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116413    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116415    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116418    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116421    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:16.122081 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:16.116423    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:16.122490 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.116428    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 09:43:16.122490 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.116524    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 03 09:43:16.122490 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.119331    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 03 09:43:16.122490 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.120469    2580 server.go:1019] "Starting client certificate rotation"
Jul 03 09:43:16.122490 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.120571    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 09:43:16.122490 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.120612    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 09:43:16.122639 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.122617    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 09:43:16.123774 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.123760    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 09:43:16.134909 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.134893    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 03 09:43:16.138666 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.138353    2580 log.go:25] "Validated CRI v1 image API"
Jul 03 09:43:16.139853 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.139834    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 03 09:43:16.144257 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.144239    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bef446a5-e9e9-44f7-aab0-7f361c03cd87:/dev/nvme0n1p3 d9693913-480c-44ab-9e5d-6a9123760eb1:/dev/nvme0n1p4]
Jul 03 09:43:16.144328 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.144256    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 03 09:43:16.149597 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.149484    2580 manager.go:216] Machine: {Timestamp:2026-07-03 09:43:16.148185997 +0000 UTC m=+0.316661393 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111511 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec273ba676841c96b9e782e5296d6c90 SystemUUID:ec273ba6-7684-1c96-b9e7-82e5296d6c90 BootID:8b81d604-d8d2-44c0-808e-331a9de0ddbb Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1e:67:16:2b:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1e:67:16:2b:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:98:5b:0d:9c:b7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 03 09:43:16.149597 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.149585    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 03 09:43:16.149716 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.149662    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 03 09:43:16.152255 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.152227    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 03 09:43:16.152433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.152417    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 09:43:16.152493 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.152262    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 03 09:43:16.153217 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.153205    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 03 09:43:16.153271 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.153225    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 03 09:43:16.153271 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.153236    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 09:43:16.154074 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.154062    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 09:43:16.155219 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.155206    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 03 09:43:16.157816 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.157802    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 09:43:16.157951 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.157940    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 03 09:43:16.158023 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.157985    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 03 09:43:16.158023 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.158008    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 03 09:43:16.158112 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.158026    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 03 09:43:16.158112 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.158038    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 03 09:43:16.158112 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.158050    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 03 09:43:16.158429 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.158414    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 09:43:16.158493 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.158439    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 09:43:16.161375 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.161357    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 03 09:43:16.162931 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.162917    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 03 09:43:16.163011 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.162947    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 03 09:43:16.163920 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163908    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 03 09:43:16.163966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163923    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 03 09:43:16.163966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163930    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 03 09:43:16.163966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163935    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 03 09:43:16.163966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163944    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 03 09:43:16.163966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163949    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 03 09:43:16.163966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163957    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 03 09:43:16.163966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163962    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 03 09:43:16.163966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163969    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 03 09:43:16.164182 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163975    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 03 09:43:16.164182 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163983    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 03 09:43:16.164182 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.163988    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 03 09:43:16.164771 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.164761    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 03 09:43:16.164771 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.164771    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 03 09:43:16.168078 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.168053    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 03 09:43:16.168078 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.168062    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 03 09:43:16.168180 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.168133    2580 server.go:1268] "Started kubelet"
Jul 03 09:43:16.168220 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.168161    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 03 09:43:16.168273 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.168208    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 03 09:43:16.168340 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.168310    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 03 09:43:16.168434 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.168385    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 03 09:43:16.169394 ip-10-0-138-110 systemd[1]: Started Kubernetes Kubelet.
Jul 03 09:43:16.169518 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.169424    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 03 09:43:16.170759 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.170722    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 03 09:43:16.173245 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.173213    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 03 09:43:16.176065 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.175194    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-110.ec2.internal.18bebe59fb9e3006  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-110.ec2.internal,UID:ip-10-0-138-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-110.ec2.internal,},FirstTimestamp:2026-07-03 09:43:16.168110086 +0000 UTC m=+0.336585491,LastTimestamp:2026-07-03 09:43:16.168110086 +0000 UTC m=+0.336585491,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-110.ec2.internal,}"
Jul 03 09:43:16.176599 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.176585    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 03 09:43:16.176599 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.176595    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 03 09:43:16.176790 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.176770    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.177582 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.177448    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 03 09:43:16.177719 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.177707    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 03 09:43:16.177959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.177938    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 03 09:43:16.178097 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.178074    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 03 09:43:16.178173 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.178164    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 03 09:43:16.180344 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.180327    2580 factory.go:55] Registering systemd factory
Jul 03 09:43:16.180344 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.180344    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 03 09:43:16.180552 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.180538    2580 factory.go:153] Registering CRI-O factory
Jul 03 09:43:16.180552 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.180554    2580 factory.go:223] Registration of the crio container factory successfully
Jul 03 09:43:16.180624 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.180613    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 03 09:43:16.180659 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.180646    2580 factory.go:103] Registering Raw factory
Jul 03 09:43:16.180659 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.180656    2580 manager.go:1196] Started watching for new ooms in manager
Jul 03 09:43:16.181250 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.181231    2580 manager.go:349] Starting recovery of all containers
Jul 03 09:43:16.181336 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.181301    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 03 09:43:16.181404 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.181344    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 03 09:43:16.191924 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.191876    2580 manager.go:354] Recovery completed
Jul 03 09:43:16.193265 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.193243    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 03 09:43:16.195999 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.195988    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:16.198366 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.198347    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:16.198429 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.198377    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:16.198429 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.198388    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:16.198928 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.198910    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 03 09:43:16.198928 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.198925    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:16.199032 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.198927    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 03 09:43:16.199032 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.198993    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 09:43:16.200236 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.200218    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:16.200236 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.200233    2580 policy_none.go:49] "None policy: Start"
Jul 03 09:43:16.200379 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.200151    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-110.ec2.internal.18bebe59fd6bd538  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-110.ec2.internal,UID:ip-10-0-138-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-110.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-110.ec2.internal,},FirstTimestamp:2026-07-03 09:43:16.198364472 +0000 UTC m=+0.366839866,LastTimestamp:2026-07-03 09:43:16.198364472 +0000 UTC m=+0.366839866,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-110.ec2.internal,}"
Jul 03 09:43:16.200379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.200253    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 03 09:43:16.200379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.200264    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 03 09:43:16.200379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.200244    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:16.200379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.200323    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:16.201253 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.201242    2580 policy_none.go:47] "Start"
Jul 03 09:43:16.201496 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.201481    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whjzq"
Jul 03 09:43:16.209471 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.209370    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whjzq"
Jul 03 09:43:16.209566 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.209366    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-110.ec2.internal.18bebe59fd6c1bb3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-110.ec2.internal,UID:ip-10-0-138-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-110.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-110.ec2.internal,},FirstTimestamp:2026-07-03 09:43:16.198382515 +0000 UTC m=+0.366857910,LastTimestamp:2026-07-03 09:43:16.198382515 +0000 UTC m=+0.366857910,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-110.ec2.internal,}"
Jul 03 09:43:16.231402 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.231383    2580 manager.go:337] "Starting Device Plugin manager"
Jul 03 09:43:16.231508 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.231419    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 03 09:43:16.231508 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.231428    2580 server.go:87] "Starting device plugin registration server"
Jul 03 09:43:16.231747 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.231735    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 03 09:43:16.231807 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.231751    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 03 09:43:16.231865 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.231822    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 03 09:43:16.231937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.231916    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 03 09:43:16.231937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.231930    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 03 09:43:16.232460 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.232440    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 03 09:43:16.232552 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.232488    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.282216 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.282189    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 03 09:43:16.285235 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.283434    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 03 09:43:16.285235 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.283475    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 03 09:43:16.285235 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.283497    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 03 09:43:16.285235 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.283532    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 03 09:43:16.286261 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.286243    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:16.333422 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.333402    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:16.334290 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.334273    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:16.334366 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.334301    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:16.334366 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.334312    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:16.334366 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.334334    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.344240 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.344223    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.344330 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.344246    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-110.ec2.internal\": node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.374301 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.374247    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.384595 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.384554    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal"]
Jul 03 09:43:16.384656 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.384638    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:16.385449 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.385432    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:16.385521 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.385464    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:16.385521 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.385476    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:16.386679 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.386667    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:16.386824 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.386805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.386879 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.386838    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:16.387485 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.387466    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:16.387575 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.387475    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:16.387575 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.387525    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:16.387575 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.387543    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:16.387575 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.387498    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:16.387714 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.387589    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:16.388778 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.388762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.388891 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.388791    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:16.389560 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.389544    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:16.389650 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.389575    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:16.389650 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.389590    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:16.410510 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.410483    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-110.ec2.internal\" not found" node="ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.415401 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.415386    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-110.ec2.internal\" not found" node="ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.474707 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.474673    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.482134 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.480363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.482134 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.480394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.482134 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.480418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a82202aae61ad36a164e7de6fe394cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-110.ec2.internal\" (UID: \"7a82202aae61ad36a164e7de6fe394cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.576816 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.576764    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.581482 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.581464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.581578 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.581499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.581578 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.581526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a82202aae61ad36a164e7de6fe394cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-110.ec2.internal\" (UID: \"7a82202aae61ad36a164e7de6fe394cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.581666 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.581586    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.581666 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.581588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a82202aae61ad36a164e7de6fe394cc-config\") pod \"kube-apiserver-proxy-ip-10-0-138-110.ec2.internal\" (UID: \"7a82202aae61ad36a164e7de6fe394cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.581666 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.581586    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdc13721c40e9855f83088b2fec76aeb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal\" (UID: \"bdc13721c40e9855f83088b2fec76aeb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.678105 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.678038    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.714322 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.714293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.718649 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:16.718538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:16.778771 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.778728    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.882668 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.882638    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:16.983705 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:16.983638    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:17.024618 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.024595    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:17.084474 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:17.084438    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:17.120019 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.119996    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 03 09:43:17.120496 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.120125    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 09:43:17.120496 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.120152    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 09:43:17.184524 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:17.184498    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:17.212960 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.212911    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 09:38:16 +0000 UTC" deadline="2027-12-23 01:32:27.426470256 +0000 UTC"
Jul 03 09:43:17.212960 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.212952    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12903h49m10.213522737s"
Jul 03 09:43:17.251376 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.251313    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:17.252753 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.252731    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:17.252862 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.252770    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:17.252862 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.252782    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:17.285117 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:17.285087    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:17.314655 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:17.314624    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc13721c40e9855f83088b2fec76aeb.slice/crio-db5ed4cb4395a2b062ba0a6d42e099d16e2c357979e4d6dbef1e4b2d92124f28 WatchSource:0}: Error finding container db5ed4cb4395a2b062ba0a6d42e099d16e2c357979e4d6dbef1e4b2d92124f28: Status 404 returned error can't find the container with id db5ed4cb4395a2b062ba0a6d42e099d16e2c357979e4d6dbef1e4b2d92124f28
Jul 03 09:43:17.314889 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:17.314868    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a82202aae61ad36a164e7de6fe394cc.slice/crio-9d82cade508b77e144f98b316b44e6f8445bc33e24f9d45ccd4f4b2b2cef4452 WatchSource:0}: Error finding container 9d82cade508b77e144f98b316b44e6f8445bc33e24f9d45ccd4f4b2b2cef4452: Status 404 returned error can't find the container with id 9d82cade508b77e144f98b316b44e6f8445bc33e24f9d45ccd4f4b2b2cef4452
Jul 03 09:43:17.321220 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.321199    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 09:43:17.386283 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:17.386256    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:17.486840 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:17.486813    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-110.ec2.internal\" not found"
Jul 03 09:43:17.505715 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.505655    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:17.581020 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.580975    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:17.589087 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.589070    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 09:43:17.590718 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.590705    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal"
Jul 03 09:43:17.602777 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.602762    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 09:43:17.723310 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:17.723285    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:18.160042 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.160015    2580 apiserver.go:52] "Watching apiserver"
Jul 03 09:43:18.166311 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.166285    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 03 09:43:18.168601 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.168576    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jsp2b","kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc","openshift-cluster-node-tuning-operator/tuned-7vkq4","openshift-image-registry/node-ca-x8wnj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal","openshift-multus/multus-5l565","openshift-multus/multus-additional-cni-plugins-49n5s","kube-system/konnectivity-agent-r4lrs","openshift-dns/node-resolver-wwcx7","openshift-multus/network-metrics-daemon-5dtvh","openshift-network-diagnostics/network-check-target-f6jcz","openshift-network-operator/iptables-alerter-rq4vk","openshift-ovn-kubernetes/ovnkube-node-gn8k5"]
Jul 03 09:43:18.170267 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.170243    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.171429 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.171410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.173241 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.172897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.173241 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.173057    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pxtss\""
Jul 03 09:43:18.173241 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.173081    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 03 09:43:18.173595 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.173577    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 03 09:43:18.173693 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.173675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 03 09:43:18.173770 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.173760    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 03 09:43:18.176921 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.174274    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:43:18.176921 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.174730    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 03 09:43:18.176921 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.174838    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 03 09:43:18.176921 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.175708    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 03 09:43:18.176921 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.175959    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ws686\""
Jul 03 09:43:18.176921 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.176375    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 03 09:43:18.176921 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.176429    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f2fqb\""
Jul 03 09:43:18.177388 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.177043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.177388 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.177154    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 03 09:43:18.178096 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.177710    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 03 09:43:18.179168 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.179119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.179568 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.179547    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 03 09:43:18.179971 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.179949    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8jlqr\""
Jul 03 09:43:18.180123 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.180108    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:43:18.180831 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.180808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.181341 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.181319    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 03 09:43:18.181460 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.181376    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 03 09:43:18.181460 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.181448    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 03 09:43:18.181885 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.181673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8fzsq\""
Jul 03 09:43:18.181885 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.181743    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:18.182504 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.182484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:18.183460 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.183358    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v7wm5\""
Jul 03 09:43:18.183460 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.183363    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 03 09:43:18.184343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.183400    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 03 09:43:18.184343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.183592    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 03 09:43:18.184343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.183715    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 03 09:43:18.184343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.183842    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 03 09:43:18.184343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.183843    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 03 09:43:18.184343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.183982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.184343 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.184063    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:18.185064 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.185037    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8pvr2\""
Jul 03 09:43:18.185199 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.185181    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 03 09:43:18.185245 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.185198    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 03 09:43:18.185973 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.185615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.187097 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.187080    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.187908 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.187890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 03 09:43:18.188006 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.187909    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hq9mx\""
Jul 03 09:43:18.188202 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.188186    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 03 09:43:18.188891 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.188867    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:18.188985 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.188938    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:18.189323 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96389e34-4e65-414b-9ab5-7fdba62634ad-host\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.189410 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5fnq\" (UniqueName: \"kubernetes.io/projected/15303116-5291-4648-b3fa-f3e29ec86915-kube-api-access-t5fnq\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.189410 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-sys-fs\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.189410 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-lib-modules\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.189410 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-var-lib-kubelet\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwx6t\" (UniqueName: \"kubernetes.io/projected/21c6274a-5c64-4170-a71c-0665a782848a-kube-api-access-jwx6t\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-modprobe-d\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-cni-bin\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8w4j\" (UniqueName: \"kubernetes.io/projected/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-kube-api-access-p8w4j\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15303116-5291-4648-b3fa-f3e29ec86915-host-slash\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-socket-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-os-release\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-cni-binary-copy\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-cni-multus\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.189621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-hostroot\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189632    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21c6274a-5c64-4170-a71c-0665a782848a-tmp\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-socket-dir-parent\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-k8s-cni-cncf-io\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-kubelet\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-conf-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-daemon-config\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189842    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4cvf7\""
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189928    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189934    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15303116-5291-4648-b3fa-f3e29ec86915-iptables-alerter-script\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.189987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-systemd\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190017    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-system-cni-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-netns\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-etc-kubernetes\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-kubernetes\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-run\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.190179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21c6274a-5c64-4170-a71c-0665a782848a-etc-tuned\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96389e34-4e65-414b-9ab5-7fdba62634ad-serviceca\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rclrh\" (UniqueName: \"kubernetes.io/projected/96389e34-4e65-414b-9ab5-7fdba62634ad-kube-api-access-rclrh\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-cni-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-cnibin\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-multus-certs\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-registration-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-device-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps9dq\" (UniqueName: \"kubernetes.io/projected/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-kube-api-access-ps9dq\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190457    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysconfig\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysctl-d\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysctl-conf\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-sys\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190560    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-host\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.190623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:18.191026 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.190682    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:18.194121 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.194089    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 09:43:18.218950 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.218905    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-727qq"
Jul 03 09:43:18.227182 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.227160    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-727qq"
Jul 03 09:43:18.279641 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.279614    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 03 09:43:18.288959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.288907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" event={"ID":"bdc13721c40e9855f83088b2fec76aeb","Type":"ContainerStarted","Data":"db5ed4cb4395a2b062ba0a6d42e099d16e2c357979e4d6dbef1e4b2d92124f28"}
Jul 03 09:43:18.290501 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.290471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" event={"ID":"7a82202aae61ad36a164e7de6fe394cc","Type":"ContainerStarted","Data":"9d82cade508b77e144f98b316b44e6f8445bc33e24f9d45ccd4f4b2b2cef4452"}
Jul 03 09:43:18.291667 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-cni-bin\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.291776 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15303116-5291-4648-b3fa-f3e29ec86915-host-slash\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.291776 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-socket-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.291776 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-dbus\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.291953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-cni-binary-copy\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.291953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291810    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-cni-bin\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.291953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-cni-multus\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.291953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291879    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15303116-5291-4648-b3fa-f3e29ec86915-host-slash\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.291953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291856    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-cni-multus\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.291953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-kubelet\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.291953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-systemd\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.291954    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-socket-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-log-socket\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-cni-bin\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-socket-dir-parent\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-k8s-cni-cncf-io\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-conf-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-systemd\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292246    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-socket-dir-parent\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292251    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-k8s-cni-cncf-io\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-systemd-units\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-node-log\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292303    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-systemd\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292310    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-conf-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:18.292362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-etc-kubernetes\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-system-cni-dir\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-cnibin\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-multus-certs\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292429    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-etc-kubernetes\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysconfig\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292480    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-multus-certs\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-sys\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-host\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292516    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-cnibin\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48-agent-certs\") pod \"konnectivity-agent-r4lrs\" (UID: \"6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48\") " pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292525    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-cni-binary-copy\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292534    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysconfig\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-device-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292584    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-host\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292598    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-sys\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps9dq\" (UniqueName: \"kubernetes.io/projected/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-kube-api-access-ps9dq\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.293098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292622    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysctl-d\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292646    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-device-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-run-netns\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-env-overrides\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292781    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysctl-d\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqtv\" (UniqueName: \"kubernetes.io/projected/20301089-d0d1-44f1-bbf1-b1f2c52c348b-kube-api-access-4mqtv\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5fnq\" (UniqueName: \"kubernetes.io/projected/15303116-5291-4648-b3fa-f3e29ec86915-kube-api-access-t5fnq\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-var-lib-kubelet\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.292957    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-var-lib-kubelet\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-ovnkube-script-lib\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293088    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lnsh\" (UniqueName: \"kubernetes.io/projected/7b7191e6-3c30-4786-a757-291e3a630ae7-kube-api-access-4lnsh\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-modprobe-d\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.293959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8w4j\" (UniqueName: \"kubernetes.io/projected/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-kube-api-access-p8w4j\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-slash\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293404    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-modprobe-d\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lsml\" (UniqueName: \"kubernetes.io/projected/23aaea9d-d419-4085-a82f-e6f8f296d15d-kube-api-access-5lsml\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-os-release\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293498    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-hostroot\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293634    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-os-release\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293673    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-hostroot\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21c6274a-5c64-4170-a71c-0665a782848a-tmp\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-etc-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-kubelet\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-daemon-config\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15303116-5291-4648-b3fa-f3e29ec86915-iptables-alerter-script\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-cni-netd\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.294569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.293944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmk6t\" (UniqueName: \"kubernetes.io/projected/187c7cbc-dab4-4265-8697-97d72b052ba8-kube-api-access-xmk6t\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b7191e6-3c30-4786-a757-291e3a630ae7-hosts-file\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294020    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cnibin\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-system-cni-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-netns\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-kubernetes\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-run\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294283    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-kubernetes\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294382    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-daemon-config\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294433    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-var-lib-kubelet\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294441    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-host-run-netns\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294452    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15303116-5291-4648-b3fa-f3e29ec86915-iptables-alerter-script\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21c6274a-5c64-4170-a71c-0665a782848a-etc-tuned\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294491    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-run\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294487    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-system-cni-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48-konnectivity-ca\") pod \"konnectivity-agent-r4lrs\" (UID: \"6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48\") " pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b7191e6-3c30-4786-a757-291e3a630ae7-tmp-dir\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.295338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cni-binary-copy\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96389e34-4e65-414b-9ab5-7fdba62634ad-serviceca\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rclrh\" (UniqueName: \"kubernetes.io/projected/96389e34-4e65-414b-9ab5-7fdba62634ad-kube-api-access-rclrh\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-cni-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-registration-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-var-lib-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysctl-conf\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294937    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-ovn\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-ovnkube-config\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.294987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/187c7cbc-dab4-4265-8697-97d72b052ba8-ovn-node-metrics-cert\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-kubelet-config\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96389e34-4e65-414b-9ab5-7fdba62634ad-host\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-sys-fs\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-lib-modules\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295136    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-multus-cni-dir\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.296079 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwx6t\" (UniqueName: \"kubernetes.io/projected/21c6274a-5c64-4170-a71c-0665a782848a-kube-api-access-jwx6t\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.296837 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-os-release\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.296837 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295199    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-registration-dir\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.296837 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295268    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96389e34-4e65-414b-9ab5-7fdba62634ad-host\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.296837 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295386    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-etc-sysctl-conf\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.296837 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295442    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-sys-fs\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.296837 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295443    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96389e34-4e65-414b-9ab5-7fdba62634ad-serviceca\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.296837 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.295760    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/21c6274a-5c64-4170-a71c-0665a782848a-lib-modules\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.298379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.298357    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21c6274a-5c64-4170-a71c-0665a782848a-tmp\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.298469 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.298419    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/21c6274a-5c64-4170-a71c-0665a782848a-etc-tuned\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.306552 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.306525    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8w4j\" (UniqueName: \"kubernetes.io/projected/36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9-kube-api-access-p8w4j\") pod \"multus-5l565\" (UID: \"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9\") " pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.306750 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.306729    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5fnq\" (UniqueName: \"kubernetes.io/projected/15303116-5291-4648-b3fa-f3e29ec86915-kube-api-access-t5fnq\") pod \"iptables-alerter-rq4vk\" (UID: \"15303116-5291-4648-b3fa-f3e29ec86915\") " pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.307077 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.307044    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rclrh\" (UniqueName: \"kubernetes.io/projected/96389e34-4e65-414b-9ab5-7fdba62634ad-kube-api-access-rclrh\") pod \"node-ca-x8wnj\" (UID: \"96389e34-4e65-414b-9ab5-7fdba62634ad\") " pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.307333 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.307307    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps9dq\" (UniqueName: \"kubernetes.io/projected/9f4b6d22-8b0c-4360-a61a-d38b7878e7dc-kube-api-access-ps9dq\") pod \"aws-ebs-csi-driver-node-jwjvc\" (UID: \"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.307956 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.307937    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwx6t\" (UniqueName: \"kubernetes.io/projected/21c6274a-5c64-4170-a71c-0665a782848a-kube-api-access-jwx6t\") pod \"tuned-7vkq4\" (UID: \"21c6274a-5c64-4170-a71c-0665a782848a\") " pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.395493 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48-konnectivity-ca\") pod \"konnectivity-agent-r4lrs\" (UID: \"6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48\") " pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:18.395493 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b7191e6-3c30-4786-a757-291e3a630ae7-tmp-dir\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.395784 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cni-binary-copy\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.395784 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-var-lib-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.395784 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:18.395784 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-ovn\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.395784 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-ovnkube-config\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.395784 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/187c7cbc-dab4-4265-8697-97d72b052ba8-ovn-node-metrics-cert\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.395784 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-kubelet-config\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395797    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-var-lib-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395929    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-kubelet-config\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395932    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b7191e6-3c30-4786-a757-291e3a630ae7-tmp-dir\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-os-release\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.395974    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-ovn\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-dbus\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-kubelet\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396049    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-os-release\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-systemd\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396124 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-log-socket\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-cni-bin\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396182    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-systemd\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396188    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48-konnectivity-ca\") pod \"konnectivity-agent-r4lrs\" (UID: \"6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48\") " pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396227    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-kubelet\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396240    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-log-socket\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-systemd-units\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396282    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-cni-bin\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396286    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cni-binary-copy\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-node-log\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396322    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-systemd-units\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.396324    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396342    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-node-log\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396380    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-ovnkube-config\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.396401    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:18.396717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396422    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-system-cni-dir\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396197    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-dbus\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.396438    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret podName:d25e6ce5-0d2c-4fa6-bee2-1d59e6806573 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:18.896395679 +0000 UTC m=+3.064871058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret") pod "global-pull-secret-syncer-jsp2b" (UID: "d25e6ce5-0d2c-4fa6-bee2-1d59e6806573") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-system-cni-dir\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.396502    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:43:18.896457469 +0000 UTC m=+3.064932857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396528    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48-agent-certs\") pod \"konnectivity-agent-r4lrs\" (UID: \"6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48\") " pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-run-netns\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-env-overrides\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396662    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-run-netns\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqtv\" (UniqueName: \"kubernetes.io/projected/20301089-d0d1-44f1-bbf1-b1f2c52c348b-kube-api-access-4mqtv\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396687    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-run-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396686    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20301089-d0d1-44f1-bbf1-b1f2c52c348b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-ovnkube-script-lib\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397498 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lnsh\" (UniqueName: \"kubernetes.io/projected/7b7191e6-3c30-4786-a757-291e3a630ae7-kube-api-access-4lnsh\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-slash\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lsml\" (UniqueName: \"kubernetes.io/projected/23aaea9d-d419-4085-a82f-e6f8f296d15d-kube-api-access-5lsml\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-etc-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-cni-netd\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396976    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-slash\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397020    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-etc-openvswitch\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396979    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397081    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397094    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-env-overrides\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.396979    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-cni-netd\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397125    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/187c7cbc-dab4-4265-8697-97d72b052ba8-host-run-ovn-kubernetes\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmk6t\" (UniqueName: \"kubernetes.io/projected/187c7cbc-dab4-4265-8697-97d72b052ba8-kube-api-access-xmk6t\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b7191e6-3c30-4786-a757-291e3a630ae7-hosts-file\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.397977 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cnibin\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.398514 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397246    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b7191e6-3c30-4786-a757-291e3a630ae7-hosts-file\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.398514 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397248    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20301089-d0d1-44f1-bbf1-b1f2c52c348b-cnibin\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.398514 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.397275    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/187c7cbc-dab4-4265-8697-97d72b052ba8-ovnkube-script-lib\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.399347 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.399328    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/187c7cbc-dab4-4265-8697-97d72b052ba8-ovn-node-metrics-cert\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.399456 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.399434    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48-agent-certs\") pod \"konnectivity-agent-r4lrs\" (UID: \"6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48\") " pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:18.402551 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.402535    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:18.402629 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.402558    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:18.402629 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.402572    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rwvq8 for pod openshift-network-diagnostics/network-check-target-f6jcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:18.402718 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.402637    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8 podName:e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:18.902621563 +0000 UTC m=+3.071096959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rwvq8" (UniqueName: "kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8") pod "network-check-target-f6jcz" (UID: "e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:18.406246 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.406227    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqtv\" (UniqueName: \"kubernetes.io/projected/20301089-d0d1-44f1-bbf1-b1f2c52c348b-kube-api-access-4mqtv\") pod \"multus-additional-cni-plugins-49n5s\" (UID: \"20301089-d0d1-44f1-bbf1-b1f2c52c348b\") " pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.406246 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.406236    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lnsh\" (UniqueName: \"kubernetes.io/projected/7b7191e6-3c30-4786-a757-291e3a630ae7-kube-api-access-4lnsh\") pod \"node-resolver-wwcx7\" (UID: \"7b7191e6-3c30-4786-a757-291e3a630ae7\") " pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.406389 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.406372    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lsml\" (UniqueName: \"kubernetes.io/projected/23aaea9d-d419-4085-a82f-e6f8f296d15d-kube-api-access-5lsml\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:18.406589 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.406571    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmk6t\" (UniqueName: \"kubernetes.io/projected/187c7cbc-dab4-4265-8697-97d72b052ba8-kube-api-access-xmk6t\") pod \"ovnkube-node-gn8k5\" (UID: \"187c7cbc-dab4-4265-8697-97d72b052ba8\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.489305 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.489229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5l565"
Jul 03 09:43:18.496863 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.496757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rq4vk"
Jul 03 09:43:18.508025 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.508001    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc"
Jul 03 09:43:18.513155 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.513136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7vkq4"
Jul 03 09:43:18.520518 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.520455    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x8wnj"
Jul 03 09:43:18.527249 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.527228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:18.535024 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.534897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:18.542987 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.542967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49n5s"
Jul 03 09:43:18.548560 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.548540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwcx7"
Jul 03 09:43:18.902127 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.902034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:18.902127 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:18.902088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:18.902358 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.902238    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:18.902358 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.902303    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:43:19.902285409 +0000 UTC m=+4.070760807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:18.902622 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.902596    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:18.902805 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:18.902663    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret podName:d25e6ce5-0d2c-4fa6-bee2-1d59e6806573 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:19.902643273 +0000 UTC m=+4.071118665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret") pod "global-pull-secret-syncer-jsp2b" (UID: "d25e6ce5-0d2c-4fa6-bee2-1d59e6806573") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:18.942694 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:18.942666    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96389e34_4e65_414b_9ab5_7fdba62634ad.slice/crio-05e8cf57e505d19219a0c144847e781ca6bdccb8300996d7896a581d456efc28 WatchSource:0}: Error finding container 05e8cf57e505d19219a0c144847e781ca6bdccb8300996d7896a581d456efc28: Status 404 returned error can't find the container with id 05e8cf57e505d19219a0c144847e781ca6bdccb8300996d7896a581d456efc28
Jul 03 09:43:18.947222 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:18.947163    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c02899_3d6f_41e4_b77c_ebf2cfbaa7d9.slice/crio-2c61a8530869c3173a86f3c92c2fc448c81fc260783f44746fd3096ea20fc45b WatchSource:0}: Error finding container 2c61a8530869c3173a86f3c92c2fc448c81fc260783f44746fd3096ea20fc45b: Status 404 returned error can't find the container with id 2c61a8530869c3173a86f3c92c2fc448c81fc260783f44746fd3096ea20fc45b
Jul 03 09:43:18.950346 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:18.950318    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c6274a_5c64_4170_a71c_0665a782848a.slice/crio-f1d015428c0e08e124258f4fd27cdf2eae064565097fcbde6712d2b825159d4b WatchSource:0}: Error finding container f1d015428c0e08e124258f4fd27cdf2eae064565097fcbde6712d2b825159d4b: Status 404 returned error can't find the container with id f1d015428c0e08e124258f4fd27cdf2eae064565097fcbde6712d2b825159d4b
Jul 03 09:43:18.952352 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:18.951180    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc1bc39_d3a4_4379_bab7_d1b3e94c5f48.slice/crio-3050bf42e7a001909ee62dc22f23eb7553597489bf3e58ec71afebb757619075 WatchSource:0}: Error finding container 3050bf42e7a001909ee62dc22f23eb7553597489bf3e58ec71afebb757619075: Status 404 returned error can't find the container with id 3050bf42e7a001909ee62dc22f23eb7553597489bf3e58ec71afebb757619075
Jul 03 09:43:19.003233 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.003200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:19.003415 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.003385    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:19.003415 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.003406    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:19.003541 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.003419    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rwvq8 for pod openshift-network-diagnostics/network-check-target-f6jcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:19.003541 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.003474    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8 podName:e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:20.003459519 +0000 UTC m=+4.171934903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwvq8" (UniqueName: "kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8") pod "network-check-target-f6jcz" (UID: "e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:19.029113 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.026570    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:19.229661 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.229445    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 09:38:18 +0000 UTC" deadline="2028-02-09 21:24:02.49923126 +0000 UTC"
Jul 03 09:43:19.230209 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.229681    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14075h40m43.269570625s"
Jul 03 09:43:19.283828 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.283789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:19.284012 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.283986    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:19.295886 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.295850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5l565" event={"ID":"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9","Type":"ContainerStarted","Data":"2c61a8530869c3173a86f3c92c2fc448c81fc260783f44746fd3096ea20fc45b"}
Jul 03 09:43:19.297704 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.297669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49n5s" event={"ID":"20301089-d0d1-44f1-bbf1-b1f2c52c348b","Type":"ContainerStarted","Data":"ec6b1b600734a249d28977a6009d7e3ebcf9f6bde2d87270dacf3592873cf465"}
Jul 03 09:43:19.299004 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.298972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc" event={"ID":"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc","Type":"ContainerStarted","Data":"b2bc4e2b16d43f46be652211f23f3cc1c3331ac4d2050bc8f5ad092b363a8c17"}
Jul 03 09:43:19.300182 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.300151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"e8a11bb58210d0aa49c49b8333e893e1d52b56e596b9bef5c5fe01fe3dced78b"}
Jul 03 09:43:19.301391 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.301353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rq4vk" event={"ID":"15303116-5291-4648-b3fa-f3e29ec86915","Type":"ContainerStarted","Data":"a658a89e58547c06ccfa1308c8a5d0d924dd023740626f51744528b6601790e1"}
Jul 03 09:43:19.302421 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.302395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7vkq4" event={"ID":"21c6274a-5c64-4170-a71c-0665a782848a","Type":"ContainerStarted","Data":"f1d015428c0e08e124258f4fd27cdf2eae064565097fcbde6712d2b825159d4b"}
Jul 03 09:43:19.303578 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.303556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r4lrs" event={"ID":"6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48","Type":"ContainerStarted","Data":"3050bf42e7a001909ee62dc22f23eb7553597489bf3e58ec71afebb757619075"}
Jul 03 09:43:19.304858 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.304833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x8wnj" event={"ID":"96389e34-4e65-414b-9ab5-7fdba62634ad","Type":"ContainerStarted","Data":"05e8cf57e505d19219a0c144847e781ca6bdccb8300996d7896a581d456efc28"}
Jul 03 09:43:19.306897 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.306874    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" event={"ID":"bdc13721c40e9855f83088b2fec76aeb","Type":"ContainerStarted","Data":"148e500a9d1cf24fbc121a800c9711573444e4951084a3e03de026e82c2d62e0"}
Jul 03 09:43:19.308111 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.308087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwcx7" event={"ID":"7b7191e6-3c30-4786-a757-291e3a630ae7","Type":"ContainerStarted","Data":"d40d33fe356b4eb040478f2faf418082f9fd2262ecfeb08a7b6a15eee440f718"}
Jul 03 09:43:19.910955 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.910905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:19.910955 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:19.910964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:19.911204 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.911107    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:19.911204 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.911170    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:43:21.911151088 +0000 UTC m=+6.079626473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:19.911634 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.911534    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:19.911634 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:19.911612    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret podName:d25e6ce5-0d2c-4fa6-bee2-1d59e6806573 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:21.911591881 +0000 UTC m=+6.080067266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret") pod "global-pull-secret-syncer-jsp2b" (UID: "d25e6ce5-0d2c-4fa6-bee2-1d59e6806573") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:20.012398 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.012355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:20.012594 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:20.012580    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:20.012667 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:20.012600    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:20.012667 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:20.012616    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rwvq8 for pod openshift-network-diagnostics/network-check-target-f6jcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:20.012799 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:20.012681    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8 podName:e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:22.012659122 +0000 UTC m=+6.181134506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwvq8" (UniqueName: "kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8") pod "network-check-target-f6jcz" (UID: "e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:20.230051 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.229960    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 09:38:18 +0000 UTC" deadline="2028-02-01 07:27:00.069492659 +0000 UTC"
Jul 03 09:43:20.230051 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.230004    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13869h43m39.839493602s"
Jul 03 09:43:20.285343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.285149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:20.285343 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:20.285311    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:20.285553 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.285366    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:20.285553 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:20.285484    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:20.314104 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.314069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" event={"ID":"7a82202aae61ad36a164e7de6fe394cc","Type":"ContainerStarted","Data":"20b0c4839a3ca2c17000aafabce567471cfd0637ac9fb741574917649d11067f"}
Jul 03 09:43:20.329105 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.329069    2580 generic.go:356] "Generic (PLEG): container finished" podID="bdc13721c40e9855f83088b2fec76aeb" containerID="148e500a9d1cf24fbc121a800c9711573444e4951084a3e03de026e82c2d62e0" exitCode=0
Jul 03 09:43:20.329247 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.329113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" event={"ID":"bdc13721c40e9855f83088b2fec76aeb","Type":"ContainerDied","Data":"148e500a9d1cf24fbc121a800c9711573444e4951084a3e03de026e82c2d62e0"}
Jul 03 09:43:20.346595 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:20.346432    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-110.ec2.internal" podStartSLOduration=2.346410606 podStartE2EDuration="2.346410606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:20.328521449 +0000 UTC m=+4.496996855" watchObservedRunningTime="2026-07-03 09:43:20.346410606 +0000 UTC m=+4.514886015"
Jul 03 09:43:21.284266 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:21.284216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:21.284838 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:21.284407    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:21.355525 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:21.355492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" event={"ID":"bdc13721c40e9855f83088b2fec76aeb","Type":"ContainerStarted","Data":"a97834455e9aed2d108cf8a6c80cccbaceabb4bdac7143fbec736e4c82b08d7c"}
Jul 03 09:43:21.928502 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:21.928459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:21.928696 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:21.928520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:21.928696 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:21.928667    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:21.929006 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:21.928733    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:43:25.928713265 +0000 UTC m=+10.097188645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:21.929183 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:21.929158    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:21.929256 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:21.929218    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret podName:d25e6ce5-0d2c-4fa6-bee2-1d59e6806573 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:25.929202138 +0000 UTC m=+10.097677525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret") pod "global-pull-secret-syncer-jsp2b" (UID: "d25e6ce5-0d2c-4fa6-bee2-1d59e6806573") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:22.029962 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:22.029179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:22.029962 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:22.029387    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:22.029962 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:22.029411    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:22.029962 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:22.029426    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rwvq8 for pod openshift-network-diagnostics/network-check-target-f6jcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:22.029962 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:22.029489    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8 podName:e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:26.029469395 +0000 UTC m=+10.197944784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwvq8" (UniqueName: "kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8") pod "network-check-target-f6jcz" (UID: "e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:22.284956 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:22.284873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:22.285442 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:22.285029    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:22.288030 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:22.288005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:22.288179 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:22.288125    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:23.283704 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:23.283670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:23.283918 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:23.283823    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:24.284592 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:24.284517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:24.285072 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:24.284657    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:24.285072 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:24.284517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:24.285191 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:24.285163    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:25.284198 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:25.283936    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:25.284198 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:25.284082    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:25.966835 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:25.966792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:25.967343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:25.966851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:25.967343 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:25.966990    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:25.967343 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:25.967057    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:43:33.967036364 +0000 UTC m=+18.135511759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:25.967343 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:25.967234    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:25.967343 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:25.967292    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret podName:d25e6ce5-0d2c-4fa6-bee2-1d59e6806573 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:33.967277642 +0000 UTC m=+18.135753045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret") pod "global-pull-secret-syncer-jsp2b" (UID: "d25e6ce5-0d2c-4fa6-bee2-1d59e6806573") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:26.068003 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:26.067965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:26.068210 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:26.068192    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:26.068289 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:26.068220    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:26.068289 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:26.068234    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rwvq8 for pod openshift-network-diagnostics/network-check-target-f6jcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:26.068450 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:26.068290    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8 podName:e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:34.068272712 +0000 UTC m=+18.236748092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwvq8" (UniqueName: "kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8") pod "network-check-target-f6jcz" (UID: "e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:26.285652 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:26.285535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:26.285808 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:26.285655    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:26.286045 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:26.286018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:26.286143 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:26.286123    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:27.283817 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:27.283783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:27.284246 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:27.283921    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:28.284593 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:28.284519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:28.285048 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:28.284661    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:28.285048 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:28.284726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:28.285048 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:28.284853    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:29.284473 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:29.284435    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:29.284658 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:29.284599    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:30.284090 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:30.283956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:30.284090 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:30.284004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:30.284294 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:30.284102    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:30.284294 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:30.284236    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:31.284343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:31.284312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:31.284836 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:31.284431    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:32.283829 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:32.283775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:32.283829 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:32.283818    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:32.284063 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:32.283919    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:32.284126 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:32.284071    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:33.284312 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:33.284279    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:33.284724 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:33.284380    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:34.029233 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:34.029197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:34.029233 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:34.029242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:34.029489 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.029369    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:34.029489 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.029403    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:34.029489 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.029452    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret podName:d25e6ce5-0d2c-4fa6-bee2-1d59e6806573 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:50.029429301 +0000 UTC m=+34.197904699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret") pod "global-pull-secret-syncer-jsp2b" (UID: "d25e6ce5-0d2c-4fa6-bee2-1d59e6806573") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:34.029489 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.029471    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:43:50.029463324 +0000 UTC m=+34.197938703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:34.129955 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:34.129922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:34.130159 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.130112    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:34.130159 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.130138    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:34.130159 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.130151    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rwvq8 for pod openshift-network-diagnostics/network-check-target-f6jcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:34.130307 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.130208    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8 podName:e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:50.130189453 +0000 UTC m=+34.298664848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwvq8" (UniqueName: "kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8") pod "network-check-target-f6jcz" (UID: "e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:34.283770 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:34.283672    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:34.283992 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.283812    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:34.283992 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:34.283874    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:34.284130 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:34.284011    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:35.284092 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:35.284057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:35.284520 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:35.284184    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:36.286494 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:36.286459    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:36.286956 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:36.286619    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:36.287118 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:36.287096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:36.287249 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:36.287227    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:37.284214 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:37.284183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:37.284367 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:37.284289    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:38.283974 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.283765    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:38.283974 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.283806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:38.283974 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:38.283914    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:38.284911 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:38.284003    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:38.391587 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.391415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc" event={"ID":"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc","Type":"ContainerStarted","Data":"9cf7855c27e221fa2971fd4439733f433597611702c60e14832d0a459075303c"}
Jul 03 09:43:38.393531 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.393505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"efb221c255dd4cf442d34a9c3a09cbb569e3b5c4eafa264c6f8068a6c1e039db"}
Jul 03 09:43:38.393650 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.393585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"b725614402238696c55f80a966b9628fc921e522e24f8918ace3d4621e99faa0"}
Jul 03 09:43:38.395095 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.395071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7vkq4" event={"ID":"21c6274a-5c64-4170-a71c-0665a782848a","Type":"ContainerStarted","Data":"3e4d865e42a3e25575aa5e88f8858439139c98369a078c0cc960703fdc8f705a"}
Jul 03 09:43:38.396525 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.396501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r4lrs" event={"ID":"6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48","Type":"ContainerStarted","Data":"60984be76ee97b352ab42bb5493be67eb8cd7e0a4f0497895a361d05eff94720"}
Jul 03 09:43:38.397856 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.397831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x8wnj" event={"ID":"96389e34-4e65-414b-9ab5-7fdba62634ad","Type":"ContainerStarted","Data":"27174b7bb38ea8b7558e856ffbc470545e23e6303a0382ac17d1d6155a6e5ef4"}
Jul 03 09:43:38.399172 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.399151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwcx7" event={"ID":"7b7191e6-3c30-4786-a757-291e3a630ae7","Type":"ContainerStarted","Data":"a11789ec3305351e4f4789ce92105bb822019a29aa60ad5c1c057c84cceffb37"}
Jul 03 09:43:38.400667 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.400647    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5l565" event={"ID":"36c02899-3d6f-41e4-b77c-ebf2cfbaa7d9","Type":"ContainerStarted","Data":"702f732b6de48090136e7dbd27af55c0a45efcb6c5491c6ce151e300b305ecde"}
Jul 03 09:43:38.402068 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.402044    2580 generic.go:356] "Generic (PLEG): container finished" podID="20301089-d0d1-44f1-bbf1-b1f2c52c348b" containerID="75e62e8facb779cb5808adcef25c5ad092ce83f6e61465a566fc872b8c9c7cf9" exitCode=0
Jul 03 09:43:38.402159 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.402077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49n5s" event={"ID":"20301089-d0d1-44f1-bbf1-b1f2c52c348b","Type":"ContainerDied","Data":"75e62e8facb779cb5808adcef25c5ad092ce83f6e61465a566fc872b8c9c7cf9"}
Jul 03 09:43:38.413435 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.413391    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-110.ec2.internal" podStartSLOduration=20.413378598 podStartE2EDuration="20.413378598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:21.371051751 +0000 UTC m=+5.539527170" watchObservedRunningTime="2026-07-03 09:43:38.413378598 +0000 UTC m=+22.581854000"
Jul 03 09:43:38.428302 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.428262    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7vkq4" podStartSLOduration=2.344267934 podStartE2EDuration="21.428248809s" totalImagesPullingTime="19.083980875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:38.413338207 +0000 UTC m=+22.581813608" watchObservedRunningTime="2026-07-03 09:43:38.428248809 +0000 UTC m=+22.596724210"
Jul 03 09:43:38.428691 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.428663    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wwcx7" podStartSLOduration=6.033701671 podStartE2EDuration="21.428653587s" totalImagesPullingTime="15.394951916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:38.428133201 +0000 UTC m=+22.596608603" watchObservedRunningTime="2026-07-03 09:43:38.428653587 +0000 UTC m=+22.597128989"
Jul 03 09:43:38.456460 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.456425    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5l565" podStartSLOduration=2.311830154 podStartE2EDuration="21.456411776s" totalImagesPullingTime="19.144581622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:38.456359961 +0000 UTC m=+22.624835362" watchObservedRunningTime="2026-07-03 09:43:38.456411776 +0000 UTC m=+22.624887176"
Jul 03 09:43:38.475197 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.475166    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r4lrs" podStartSLOduration=2.390317824 podStartE2EDuration="21.475155052s" totalImagesPullingTime="19.084837228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:38.475075745 +0000 UTC m=+22.643551146" watchObservedRunningTime="2026-07-03 09:43:38.475155052 +0000 UTC m=+22.643630452"
Jul 03 09:43:38.515984 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:38.515951    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x8wnj" podStartSLOduration=6.107671829 podStartE2EDuration="21.515938046s" totalImagesPullingTime="15.408266217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:38.515826629 +0000 UTC m=+22.684302029" watchObservedRunningTime="2026-07-03 09:43:38.515938046 +0000 UTC m=+22.684413447"
Jul 03 09:43:39.284518 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.284490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:39.285025 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:39.284609    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:39.382178 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.382146    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:39.383160 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.383144    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:39.408464 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.408434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"406a2458aa6ef341735ce74548f387d5641e773939b6fdcfc5486ece9f5fb0ea"}
Jul 03 09:43:39.408577 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.408519    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"773d1d30a46791ece4c5343ddcf4819683c7b1e0da61671393650d79b641236d"}
Jul 03 09:43:39.408577 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.408560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"78e80408a042c7b87e0691ec52554b729fabcb89ccc3cd37728a89ab616c1a17"}
Jul 03 09:43:39.408649 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.408588    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"06a3a36900f16ac739d4ab859f220455549273186ae3f9fce339d42b31f0aeb3"}
Jul 03 09:43:39.409201 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.409173    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:39.409288 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.409229    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r4lrs"
Jul 03 09:43:39.873906 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:39.873871    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 03 09:43:40.242200 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:40.242073    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T09:43:39.873891358Z","UUID":"cf140515-daae-4016-b5f0-71c1c202604c","Handler":null,"Name":"","Endpoint":""}
Jul 03 09:43:40.243682 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:40.243657    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 03 09:43:40.243826 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:40.243699    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 03 09:43:40.283766 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:40.283722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:40.283924 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:40.283902    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:40.284254 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:40.284216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:40.284373 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:40.284334    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:40.413235 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:40.413191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc" event={"ID":"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc","Type":"ContainerStarted","Data":"7a717489975fc83e527253ea9aaf406141be4e8a2bb0fcab5576aa5cc0e281c5"}
Jul 03 09:43:40.414797 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:40.414768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rq4vk" event={"ID":"15303116-5291-4648-b3fa-f3e29ec86915","Type":"ContainerStarted","Data":"ee7f90d84a481d5eb3963f8bb427f552b05d80123dfca85bebbcd6dad536a09d"}
Jul 03 09:43:40.429697 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:40.429637    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rq4vk" podStartSLOduration=4.352682561 podStartE2EDuration="23.429622939s" totalImagesPullingTime="19.076940378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:40.428866552 +0000 UTC m=+24.597341954" watchObservedRunningTime="2026-07-03 09:43:40.429622939 +0000 UTC m=+24.598098341"
Jul 03 09:43:41.284807 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:41.284610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:41.284951 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:41.284881    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:41.419661 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:41.419572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc" event={"ID":"9f4b6d22-8b0c-4360-a61a-d38b7878e7dc","Type":"ContainerStarted","Data":"81016a4fe41e85fc6d3dcb65387b95ce739f487ae2e201c4896e321dc0d4fdb5"}
Jul 03 09:43:41.423419 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:41.423388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"8c95fccf7dea49d60a11c189813fe576ba0643aecc3c3eb38c3b160826856d45"}
Jul 03 09:43:41.439920 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:41.438362    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jwjvc" podStartSLOduration=2.71976043 podStartE2EDuration="24.438341204s" totalImagesPullingTime="21.718580774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:41.436172539 +0000 UTC m=+25.604647940" watchObservedRunningTime="2026-07-03 09:43:41.438341204 +0000 UTC m=+25.606816587"
Jul 03 09:43:42.284721 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:42.284686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:42.284955 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:42.284838    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:42.284955 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:42.284882    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:42.285069 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:42.284964    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:43.284195 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:43.284164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:43.284681 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:43.284283    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:44.284218 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:44.284137    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:44.284905 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:44.284147    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:44.284905 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:44.284299    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:44.284905 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:44.284316    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:45.284385 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.284158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:45.284909 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:45.284437    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:45.434226 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.434190    2580 generic.go:356] "Generic (PLEG): container finished" podID="20301089-d0d1-44f1-bbf1-b1f2c52c348b" containerID="7b05c9beeabfc4ce9e6fd9de2e1db694e07818f4478ba433dc83116aee458e21" exitCode=0
Jul 03 09:43:45.434417 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.434265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49n5s" event={"ID":"20301089-d0d1-44f1-bbf1-b1f2c52c348b","Type":"ContainerDied","Data":"7b05c9beeabfc4ce9e6fd9de2e1db694e07818f4478ba433dc83116aee458e21"}
Jul 03 09:43:45.437890 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.437866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" event={"ID":"187c7cbc-dab4-4265-8697-97d72b052ba8","Type":"ContainerStarted","Data":"83419f137d568363a25ded40a74abf3d19f3c74c7fb0cdda52085e2461cf5348"}
Jul 03 09:43:45.438097 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.438078    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:45.438193 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.438148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:45.454435 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.454410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:45.454569 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.454517    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:45.482776 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:45.482710    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5" podStartSLOduration=9.338130997 podStartE2EDuration="28.482695995s" totalImagesPullingTime="19.144564998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:45.482626315 +0000 UTC m=+29.651101716" watchObservedRunningTime="2026-07-03 09:43:45.482695995 +0000 UTC m=+29.651171395"
Jul 03 09:43:46.284757 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.284716    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:46.285209 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:46.284821    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:46.285209 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.284905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:46.285209 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:46.285055    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:46.441302 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.440899    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 03 09:43:46.596281 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.596204    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f6jcz"]
Jul 03 09:43:46.596440 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.596295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:46.596440 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:46.596369    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:46.599007 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.598980    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5dtvh"]
Jul 03 09:43:46.599132 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.599065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:46.599194 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:46.599140    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:46.607410 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.607385    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jsp2b"]
Jul 03 09:43:46.607528 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:46.607470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:46.607592 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:46.607546    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:47.445548 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:47.445514    2580 generic.go:356] "Generic (PLEG): container finished" podID="20301089-d0d1-44f1-bbf1-b1f2c52c348b" containerID="04f6bee2d1dab57fdfc2d9c1ee829a2ef232ad45e7b46c839fb54a77a0f08ee1" exitCode=0
Jul 03 09:43:47.446009 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:47.445594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49n5s" event={"ID":"20301089-d0d1-44f1-bbf1-b1f2c52c348b","Type":"ContainerDied","Data":"04f6bee2d1dab57fdfc2d9c1ee829a2ef232ad45e7b46c839fb54a77a0f08ee1"}
Jul 03 09:43:47.446009 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:47.445696    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 03 09:43:47.661476 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:47.661402    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:43:48.284068 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:48.283896    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:48.284204 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:48.283911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:48.284204 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:48.284137    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:48.284283 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:48.284246    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:48.284283 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:48.283962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:48.284365 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:48.284342    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:49.451307 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:49.451278    2580 generic.go:356] "Generic (PLEG): container finished" podID="20301089-d0d1-44f1-bbf1-b1f2c52c348b" containerID="0bbaf18a84ec94ef8308835489e367e38116921ca2637d04d0e931dfe36f6c4c" exitCode=0
Jul 03 09:43:49.451307 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:49.451312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49n5s" event={"ID":"20301089-d0d1-44f1-bbf1-b1f2c52c348b","Type":"ContainerDied","Data":"0bbaf18a84ec94ef8308835489e367e38116921ca2637d04d0e931dfe36f6c4c"}
Jul 03 09:43:50.051502 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.051463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:50.051659 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.051518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:50.051659 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.051612    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:50.051659 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.051647    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:50.051833 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.051680    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret podName:d25e6ce5-0d2c-4fa6-bee2-1d59e6806573 nodeName:}" failed. No retries permitted until 2026-07-03 09:44:22.051661007 +0000 UTC m=+66.220136387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret") pod "global-pull-secret-syncer-jsp2b" (UID: "d25e6ce5-0d2c-4fa6-bee2-1d59e6806573") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:50.051833 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.051697    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:44:22.051689858 +0000 UTC m=+66.220165237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:50.152206 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.152170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:50.152380 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.152348    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:50.152380 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.152378    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:50.152488 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.152393    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rwvq8 for pod openshift-network-diagnostics/network-check-target-f6jcz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:50.152488 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.152456    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8 podName:e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c nodeName:}" failed. No retries permitted until 2026-07-03 09:44:22.152437599 +0000 UTC m=+66.320912985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwvq8" (UniqueName: "kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8") pod "network-check-target-f6jcz" (UID: "e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:50.284787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.284757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:50.284966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.284794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:50.284966 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.284757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:50.284966 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.284897    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsp2b" podUID="d25e6ce5-0d2c-4fa6-bee2-1d59e6806573"
Jul 03 09:43:50.285136 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.284966    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:43:50.285136 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.285026    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f6jcz" podUID="e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c"
Jul 03 09:43:50.708327 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.708293    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-110.ec2.internal" event="NodeReady"
Jul 03 09:43:50.708864 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.708456    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 03 09:43:50.747946 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.747916    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj"]
Jul 03 09:43:50.750639 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.749856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj"
Jul 03 09:43:50.751013 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.750987    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cdc6dd77d-mc878"]
Jul 03 09:43:50.752535 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.752507    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zlvq5\""
Jul 03 09:43:50.752535 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.752519    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 09:43:50.752691 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.752631    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 09:43:50.752888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.752873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.755401 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.755383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 03 09:43:50.755775 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.755752    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 03 09:43:50.755882 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.755773    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 03 09:43:50.755882 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.755795    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jhcf\""
Jul 03 09:43:50.760981 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.760959    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jtcvp"]
Jul 03 09:43:50.762643 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.762626    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 03 09:43:50.763028 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.763011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jtcvp"
Jul 03 09:43:50.763371 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.763328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj"]
Jul 03 09:43:50.765298 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.765117    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 03 09:43:50.765674 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.765597    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 03 09:43:50.765889 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.765841    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 03 09:43:50.765889 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.765855    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bjlsv\""
Jul 03 09:43:50.766664 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.766633    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-whxmx"]
Jul 03 09:43:50.768724 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.768632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.770827 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.770801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 03 09:43:50.770919 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.770827    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 03 09:43:50.770919 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.770805    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ckvl\""
Jul 03 09:43:50.775674 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.775624    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cdc6dd77d-mc878"]
Jul 03 09:43:50.778204 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.778183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whxmx"]
Jul 03 09:43:50.788850 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.788825    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jtcvp"]
Jul 03 09:43:50.858767 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.858670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ccx\" (UniqueName: \"kubernetes.io/projected/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-kube-api-access-42ccx\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.858767 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.858715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-image-registry-private-configuration\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.858767 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.858765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-trusted-ca\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.859026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.858791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g75s9\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-kube-api-access-g75s9\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.859026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.858868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sppj\" (UniqueName: \"kubernetes.io/projected/e30dcf04-10bf-4686-b5a6-8acf4d64efe5-kube-api-access-7sppj\") pod \"network-check-source-989f8b8dc-5lgcj\" (UID: \"e30dcf04-10bf-4686-b5a6-8acf4d64efe5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj"
Jul 03 09:43:50.859026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.858920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.859026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.858988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8274ca7d-200c-4e1d-af67-ed18b9c332be-ca-trust-extracted\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.859026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.859010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-installation-pull-secrets\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.859026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.859027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/903f85b0-1190-487a-87db-8ef46a6bd144-cert\") pod \"ingress-canary-jtcvp\" (UID: \"903f85b0-1190-487a-87db-8ef46a6bd144\") " pod="openshift-ingress-canary/ingress-canary-jtcvp"
Jul 03 09:43:50.859293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.859042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkq4d\" (UniqueName: \"kubernetes.io/projected/903f85b0-1190-487a-87db-8ef46a6bd144-kube-api-access-kkq4d\") pod \"ingress-canary-jtcvp\" (UID: \"903f85b0-1190-487a-87db-8ef46a6bd144\") " pod="openshift-ingress-canary/ingress-canary-jtcvp"
Jul 03 09:43:50.859293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.859059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-config-volume\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.859293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.859078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.859293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.859098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-bound-sa-token\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.859293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.859120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-tmp-dir\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.859293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.859137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-certificates\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960021 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.959989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ccx\" (UniqueName: \"kubernetes.io/projected/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-kube-api-access-42ccx\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.960021 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-image-registry-private-configuration\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960203 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-trusted-ca\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960238 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g75s9\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-kube-api-access-g75s9\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960278 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sppj\" (UniqueName: \"kubernetes.io/projected/e30dcf04-10bf-4686-b5a6-8acf4d64efe5-kube-api-access-7sppj\") pod \"network-check-source-989f8b8dc-5lgcj\" (UID: \"e30dcf04-10bf-4686-b5a6-8acf4d64efe5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj"
Jul 03 09:43:50.960326 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960372 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8274ca7d-200c-4e1d-af67-ed18b9c332be-ca-trust-extracted\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960425 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.960405    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:43:50.960476 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.960429    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:43:50.960528 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.960487    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:43:51.460467191 +0000 UTC m=+35.628942583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:43:50.960590 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-installation-pull-secrets\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960590 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/903f85b0-1190-487a-87db-8ef46a6bd144-cert\") pod \"ingress-canary-jtcvp\" (UID: \"903f85b0-1190-487a-87db-8ef46a6bd144\") " pod="openshift-ingress-canary/ingress-canary-jtcvp"
Jul 03 09:43:50.960692 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960591    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8274ca7d-200c-4e1d-af67-ed18b9c332be-ca-trust-extracted\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960692 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkq4d\" (UniqueName: \"kubernetes.io/projected/903f85b0-1190-487a-87db-8ef46a6bd144-kube-api-access-kkq4d\") pod \"ingress-canary-jtcvp\" (UID: \"903f85b0-1190-487a-87db-8ef46a6bd144\") " pod="openshift-ingress-canary/ingress-canary-jtcvp"
Jul 03 09:43:50.960692 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-config-volume\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.960692 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.960928 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-bound-sa-token\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.960928 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-tmp-dir\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.960928 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.960763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-certificates\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.961148 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.961127    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:50.961148 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.961139    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-tmp-dir\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.961256 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.961136    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-trusted-ca\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.961256 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:50.961193    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:51.461172952 +0000 UTC m=+35.629648344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:50.961256 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.961228    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-config-volume\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.961389 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.961261    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-certificates\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.964183 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.964160    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/903f85b0-1190-487a-87db-8ef46a6bd144-cert\") pod \"ingress-canary-jtcvp\" (UID: \"903f85b0-1190-487a-87db-8ef46a6bd144\") " pod="openshift-ingress-canary/ingress-canary-jtcvp"
Jul 03 09:43:50.964183 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.964169    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-image-registry-private-configuration\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.964313 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.964201    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-installation-pull-secrets\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.971122 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.971091    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ccx\" (UniqueName: \"kubernetes.io/projected/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-kube-api-access-42ccx\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:50.972185 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.972161    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkq4d\" (UniqueName: \"kubernetes.io/projected/903f85b0-1190-487a-87db-8ef46a6bd144-kube-api-access-kkq4d\") pod \"ingress-canary-jtcvp\" (UID: \"903f85b0-1190-487a-87db-8ef46a6bd144\") " pod="openshift-ingress-canary/ingress-canary-jtcvp"
Jul 03 09:43:50.972266 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.972168    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sppj\" (UniqueName: \"kubernetes.io/projected/e30dcf04-10bf-4686-b5a6-8acf4d64efe5-kube-api-access-7sppj\") pod \"network-check-source-989f8b8dc-5lgcj\" (UID: \"e30dcf04-10bf-4686-b5a6-8acf4d64efe5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj"
Jul 03 09:43:50.973130 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.973111    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-bound-sa-token\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:50.973274 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:50.973155    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g75s9\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-kube-api-access-g75s9\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:51.063300 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:51.063265    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj"
Jul 03 09:43:51.080530 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:51.080506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jtcvp"
Jul 03 09:43:51.218440 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:51.218197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj"]
Jul 03 09:43:51.221165 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:51.221140    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jtcvp"]
Jul 03 09:43:51.223268 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:51.223241    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30dcf04_10bf_4686_b5a6_8acf4d64efe5.slice/crio-1bb370ab714e4b8f78535931c3de65be06bea1a698f92b1dff969e8cde40e145 WatchSource:0}: Error finding container 1bb370ab714e4b8f78535931c3de65be06bea1a698f92b1dff969e8cde40e145: Status 404 returned error can't find the container with id 1bb370ab714e4b8f78535931c3de65be06bea1a698f92b1dff969e8cde40e145
Jul 03 09:43:51.225015 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:43:51.224986    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903f85b0_1190_487a_87db_8ef46a6bd144.slice/crio-d75203fd1c28522d191f6a6046ef06afce7d4726064e1c389c999e7ef6b3c802 WatchSource:0}: Error finding container d75203fd1c28522d191f6a6046ef06afce7d4726064e1c389c999e7ef6b3c802: Status 404 returned error can't find the container with id d75203fd1c28522d191f6a6046ef06afce7d4726064e1c389c999e7ef6b3c802
Jul 03 09:43:51.458348 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:51.458222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj" event={"ID":"e30dcf04-10bf-4686-b5a6-8acf4d64efe5","Type":"ContainerStarted","Data":"1bb370ab714e4b8f78535931c3de65be06bea1a698f92b1dff969e8cde40e145"}
Jul 03 09:43:51.459460 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:51.459429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jtcvp" event={"ID":"903f85b0-1190-487a-87db-8ef46a6bd144","Type":"ContainerStarted","Data":"d75203fd1c28522d191f6a6046ef06afce7d4726064e1c389c999e7ef6b3c802"}
Jul 03 09:43:51.464892 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:51.464857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:51.465016 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:51.464922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:51.465016 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:51.465010    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:43:51.465126 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:51.465024    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:43:51.465126 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:51.465077    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:43:52.465065053 +0000 UTC m=+36.633540435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:43:51.465126 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:51.465089    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:51.465257 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:51.465147    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:52.465129045 +0000 UTC m=+36.633604442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:52.284333 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.284298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:43:52.284960 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.284445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:43:52.284960 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.284312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:43:52.287195 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.287019    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 09:43:52.288055 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.288035    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 09:43:52.288270 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.288252    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-98cbg\""
Jul 03 09:43:52.288447 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.288432    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bb7nd\""
Jul 03 09:43:52.473376 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.473135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:52.473376 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.473258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:52.473605 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:52.473434    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:52.473605 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:52.473502    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:54.473480712 +0000 UTC m=+38.641956099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:52.473900 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:52.473803    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:43:52.473900 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:52.473825    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:43:52.473900 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:52.473876    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:43:54.473859308 +0000 UTC m=+38.642334688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:43:52.648838 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.647835    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"]
Jul 03 09:43:52.650052 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.650025    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:52.653170 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.653145    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 03 09:43:52.653290 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.653216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ttsjk\""
Jul 03 09:43:52.654472 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.654452    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 03 09:43:52.661607 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.659865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"]
Jul 03 09:43:52.775039 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.775004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:52.775220 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.775175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:52.876279 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.876241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:52.876459 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.876369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:52.876459 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:52.876418    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:43:52.876563 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:52.876499    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:43:53.376473557 +0000 UTC m=+37.544948944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:43:52.877178 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:52.877155    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:53.381122 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:53.381076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:53.381491 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:53.381230    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:43:53.381491 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:53.381304    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:43:54.381284733 +0000 UTC m=+38.549760127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:43:54.389499 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:54.389457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:54.389971 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:54.389626    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:43:54.389971 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:54.389703    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:43:56.389682426 +0000 UTC m=+40.558157809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:43:54.490031 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:54.489993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:54.490196 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:54.490066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:54.490196 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:54.490159    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:43:54.490196 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:54.490180    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:43:54.490196 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:54.490193    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:54.490398 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:54.490240    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:43:58.490224381 +0000 UTC m=+42.658699779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:43:54.490398 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:54.490260    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:58.490251279 +0000 UTC m=+42.658726660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:56.406592 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:56.406564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:43:56.406919 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:56.406674    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:43:56.406919 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:56.406726    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:44:00.406712929 +0000 UTC m=+44.575188308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:43:57.478009 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:57.477975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jtcvp" event={"ID":"903f85b0-1190-487a-87db-8ef46a6bd144","Type":"ContainerStarted","Data":"34a5357f6c9e680ae72f4df1ee254254902cc85dcbd1f3fdc171fa4ab64caa65"}
Jul 03 09:43:57.480808 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:57.480779    2580 generic.go:356] "Generic (PLEG): container finished" podID="20301089-d0d1-44f1-bbf1-b1f2c52c348b" containerID="9245081e755f8fcbb059f4ecdac3e0164b5553e7bbef6ec0ed450b35e7a39da7" exitCode=0
Jul 03 09:43:57.480915 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:57.480853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49n5s" event={"ID":"20301089-d0d1-44f1-bbf1-b1f2c52c348b","Type":"ContainerDied","Data":"9245081e755f8fcbb059f4ecdac3e0164b5553e7bbef6ec0ed450b35e7a39da7"}
Jul 03 09:43:57.482361 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:57.482337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj" event={"ID":"e30dcf04-10bf-4686-b5a6-8acf4d64efe5","Type":"ContainerStarted","Data":"6c2c5c416dc11a760bf8bf3156880a8da594b9f0e4731049c65834013179101c"}
Jul 03 09:43:57.493532 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:57.493488    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jtcvp" podStartSLOduration=2.277735923 podStartE2EDuration="7.493473121s" totalImagesPullingTime="5.215737198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:57.49286386 +0000 UTC m=+41.661339261" watchObservedRunningTime="2026-07-03 09:43:57.493473121 +0000 UTC m=+41.661948522"
Jul 03 09:43:57.509117 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:57.509079    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5lgcj" podStartSLOduration=26.28466714 podStartE2EDuration="31.509066287s" totalImagesPullingTime="5.224399147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:57.508631186 +0000 UTC m=+41.677106587" watchObservedRunningTime="2026-07-03 09:43:57.509066287 +0000 UTC m=+41.677541687"
Jul 03 09:43:58.487167 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:58.487133    2580 generic.go:356] "Generic (PLEG): container finished" podID="20301089-d0d1-44f1-bbf1-b1f2c52c348b" containerID="a346171e806d828847e7f3bc82c89a6fcb916049daf55a687c84b04bc70446e8" exitCode=0
Jul 03 09:43:58.487617 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:58.487216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49n5s" event={"ID":"20301089-d0d1-44f1-bbf1-b1f2c52c348b","Type":"ContainerDied","Data":"a346171e806d828847e7f3bc82c89a6fcb916049daf55a687c84b04bc70446e8"}
Jul 03 09:43:58.523829 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:58.523798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:43:58.523950 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:58.523930    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:58.523950 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:58.523939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:43:58.524045 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:58.523995    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:44:06.523976677 +0000 UTC m=+50.692452062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:58.524102 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:58.524067    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:43:58.524102 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:58.524081    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:43:58.524182 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:43:58.524151    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:44:06.524133003 +0000 UTC m=+50.692608383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:43:59.492479 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:59.492441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49n5s" event={"ID":"20301089-d0d1-44f1-bbf1-b1f2c52c348b","Type":"ContainerStarted","Data":"73f55c83e41f0057e70c31862257e3176cd7b249cb9d09a82e334df7ca685d00"}
Jul 03 09:43:59.517394 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:43:59.517336    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-49n5s" podStartSLOduration=7.807874076 podStartE2EDuration="42.517320329s" totalImagesPullingTime="34.709446253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:59.516780338 +0000 UTC m=+43.685255740" watchObservedRunningTime="2026-07-03 09:43:59.517320329 +0000 UTC m=+43.685795729"
Jul 03 09:44:00.438555 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:00.438522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:44:00.438752 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:00.438650    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:44:00.438752 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:00.438706    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:44:08.438690511 +0000 UTC m=+52.607165890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:44:06.580883 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:06.580848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:44:06.581265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:06.580902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:44:06.581265 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:06.581014    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:44:06.581265 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:06.581037    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:44:06.581265 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:06.581097    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:44:22.581079431 +0000 UTC m=+66.749554814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:44:06.581265 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:06.581117    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:44:06.581265 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:06.581156    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:44:22.581145627 +0000 UTC m=+66.749621005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:44:08.493415 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:08.493373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:44:08.493788 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:08.493515    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:44:08.493788 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:08.493579    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:44:24.493563818 +0000 UTC m=+68.662039197 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:44:18.457824 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:18.457796    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn8k5"
Jul 03 09:44:22.088287 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.088248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:44:22.088287 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.088287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:44:22.090836 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.090811    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 09:44:22.090918 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.090902    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 09:44:22.098784 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:22.098762    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 09:44:22.098846 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:22.098836    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:45:26.098820447 +0000 UTC m=+130.267295827 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : secret "metrics-daemon-secret" not found
Jul 03 09:44:22.101643 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.101624    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d25e6ce5-0d2c-4fa6-bee2-1d59e6806573-original-pull-secret\") pod \"global-pull-secret-syncer-jsp2b\" (UID: \"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573\") " pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:44:22.189229 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.189201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:44:22.191493 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.191473    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwvq8\" (UniqueName: \"kubernetes.io/projected/e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c-kube-api-access-rwvq8\") pod \"network-check-target-f6jcz\" (UID: \"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c\") " pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:44:22.308381 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.308343    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsp2b"
Jul 03 09:44:22.317238 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.317219    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bb7nd\""
Jul 03 09:44:22.336327 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.336120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:44:22.445797 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.445716    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jsp2b"]
Jul 03 09:44:22.449144 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:44:22.449119    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25e6ce5_0d2c_4fa6_bee2_1d59e6806573.slice/crio-d87523f62df9855eb15a28f773de1b06ff6c00d563edf6e2dad1aa7428ac0b9a WatchSource:0}: Error finding container d87523f62df9855eb15a28f773de1b06ff6c00d563edf6e2dad1aa7428ac0b9a: Status 404 returned error can't find the container with id d87523f62df9855eb15a28f773de1b06ff6c00d563edf6e2dad1aa7428ac0b9a
Jul 03 09:44:22.470113 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.470091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f6jcz"]
Jul 03 09:44:22.473488 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:44:22.473459    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c69ed5_a766_4a65_bc45_d5bdb7cbf25c.slice/crio-192c3aa441d59973312de55d044c16964e7b4b1b72a28352a53e23e09f643410 WatchSource:0}: Error finding container 192c3aa441d59973312de55d044c16964e7b4b1b72a28352a53e23e09f643410: Status 404 returned error can't find the container with id 192c3aa441d59973312de55d044c16964e7b4b1b72a28352a53e23e09f643410
Jul 03 09:44:22.544905 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.544869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f6jcz" event={"ID":"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c","Type":"ContainerStarted","Data":"1fc04a7a729ef2982b2af864de2af1a6c66ff8d3615daa30e8d181d5c3a13486"}
Jul 03 09:44:22.545011 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.544925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f6jcz" event={"ID":"e6c69ed5-a766-4a65-bc45-d5bdb7cbf25c","Type":"ContainerStarted","Data":"192c3aa441d59973312de55d044c16964e7b4b1b72a28352a53e23e09f643410"}
Jul 03 09:44:22.545011 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.544951    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:44:22.546001 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.545979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jsp2b" event={"ID":"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573","Type":"ContainerStarted","Data":"d87523f62df9855eb15a28f773de1b06ff6c00d563edf6e2dad1aa7428ac0b9a"}
Jul 03 09:44:22.560520 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.560483    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f6jcz" podStartSLOduration=65.560469641 podStartE2EDuration="1m5.560469641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:44:22.559521583 +0000 UTC m=+66.727996996" watchObservedRunningTime="2026-07-03 09:44:22.560469641 +0000 UTC m=+66.728945043"
Jul 03 09:44:22.593676 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.593603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:44:22.593790 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:22.593679    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:44:22.593790 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:22.593716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:44:22.593790 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:22.593752    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:44:54.593717198 +0000 UTC m=+98.762192577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:44:22.593959 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:22.593805    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:44:22.593959 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:22.593819    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:44:22.593959 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:22.593859    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:44:54.593845508 +0000 UTC m=+98.762320887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:44:24.508871 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:24.508816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:44:24.509328 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:24.508972    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:44:24.509328 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:24.509044    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:44:56.509027191 +0000 UTC m=+100.677502585 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:44:27.560089 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:27.560041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jsp2b" event={"ID":"d25e6ce5-0d2c-4fa6-bee2-1d59e6806573","Type":"ContainerStarted","Data":"89c0ae11d4ab3442d273d56bf0ab1e3b07c19808648e6a90e2be70dc3919e9db"}
Jul 03 09:44:53.550884 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:53.550775    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f6jcz"
Jul 03 09:44:53.572330 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:53.572278    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jsp2b" podStartSLOduration=91.862909908 podStartE2EDuration="1m36.572264031s" totalImagesPullingTime="4.709354123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:44:27.576414797 +0000 UTC m=+71.744890199" watchObservedRunningTime="2026-07-03 09:44:53.572264031 +0000 UTC m=+97.740739422"
Jul 03 09:44:54.620985 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:54.620955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:44:54.621359 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:54.620996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:44:54.621359 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:54.621105    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:44:54.621359 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:54.621109    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:44:54.621359 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:54.621127    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:44:54.621359 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:54.621163    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:45:58.621147601 +0000 UTC m=+162.789622996 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:44:54.621359 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:54.621177    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:45:58.62117175 +0000 UTC m=+162.789647129 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:44:56.535510 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:56.535469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:44:56.535939 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:56.535602    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:44:56.535939 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:44:56.535663    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:46:00.535648716 +0000 UTC m=+164.704124095 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:44:58.451085 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.451041    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"]
Jul 03 09:44:58.481502 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.481471    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"]
Jul 03 09:44:58.481644 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.481579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.483953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.483926    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 03 09:44:58.484068 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.483927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 03 09:44:58.484068 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.483932    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 03 09:44:58.484937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.484910    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 03 09:44:58.484937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.484938    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 03 09:44:58.485112 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.484920    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 03 09:44:58.485112 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.484920    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 03 09:44:58.548083 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.548062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.548212 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.548088    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c3cf6-7444-419a-b636-dae96fb9c71a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.548212 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.548118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-ca\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.548212 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.548133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-hub\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.548326 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.548228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.548326 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.548257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7qw6\" (UniqueName: \"kubernetes.io/projected/e17c3cf6-7444-419a-b636-dae96fb9c71a-kube-api-access-t7qw6\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.649298 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.649267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.649298 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.649300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7qw6\" (UniqueName: \"kubernetes.io/projected/e17c3cf6-7444-419a-b636-dae96fb9c71a-kube-api-access-t7qw6\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.649478 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.649342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.649478 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.649367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c3cf6-7444-419a-b636-dae96fb9c71a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.649478 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.649395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-ca\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.649478 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.649412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-hub\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.650120 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.650094    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e17c3cf6-7444-419a-b636-dae96fb9c71a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.651782 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.651755    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.651895 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.651825    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-ca\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.651895 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.651830    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.651895 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.651857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e17c3cf6-7444-419a-b636-dae96fb9c71a-hub\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.660865 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.660844    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7qw6\" (UniqueName: \"kubernetes.io/projected/e17c3cf6-7444-419a-b636-dae96fb9c71a-kube-api-access-t7qw6\") pod \"cluster-proxy-proxy-agent-7598d886c4-wjjcc\" (UID: \"e17c3cf6-7444-419a-b636-dae96fb9c71a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.805763 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.805719    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:44:58.947365 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:58.947328    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"]
Jul 03 09:44:58.950086 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:44:58.950058    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode17c3cf6_7444_419a_b636_dae96fb9c71a.slice/crio-afc3f733eda2f67636b5b9f286056117695dfcd80de93e411aece244ca20c283 WatchSource:0}: Error finding container afc3f733eda2f67636b5b9f286056117695dfcd80de93e411aece244ca20c283: Status 404 returned error can't find the container with id afc3f733eda2f67636b5b9f286056117695dfcd80de93e411aece244ca20c283
Jul 03 09:44:59.640052 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:44:59.640016    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" event={"ID":"e17c3cf6-7444-419a-b636-dae96fb9c71a","Type":"ContainerStarted","Data":"afc3f733eda2f67636b5b9f286056117695dfcd80de93e411aece244ca20c283"}
Jul 03 09:45:02.650796 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:02.650684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" event={"ID":"e17c3cf6-7444-419a-b636-dae96fb9c71a","Type":"ContainerStarted","Data":"62f1c38e9a119022a05d591a106a99e73f6dd64b1d81bb41c320c5b5b81ffe03"}
Jul 03 09:45:02.650796 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:02.650747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" event={"ID":"e17c3cf6-7444-419a-b636-dae96fb9c71a","Type":"ContainerStarted","Data":"3fdeb4b922a593af94cf060ac01eea2f3eed0c2068e2b90a73641128ed454d51"}
Jul 03 09:45:02.650796 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:02.650761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" event={"ID":"e17c3cf6-7444-419a-b636-dae96fb9c71a","Type":"ContainerStarted","Data":"69c71cb30356c7512ba2a9ca0d90f29fbe608548c9a70f9815d2ccad06eccdf6"}
Jul 03 09:45:26.154365 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:26.154315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:45:26.154832 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:26.154445    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 09:45:26.154832 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:26.154498    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:47:28.154483767 +0000 UTC m=+252.322959146 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : secret "metrics-daemon-secret" not found
Jul 03 09:45:53.772188 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:53.772144    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" podUID="8274ca7d-200c-4e1d-af67-ed18b9c332be"
Jul 03 09:45:53.787325 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:53.787305    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-whxmx" podUID="cd9d1bfd-444a-4357-b5af-2c8ad6e0af57"
Jul 03 09:45:53.789345 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:53.789321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:45:54.795545 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:54.795510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whxmx"
Jul 03 09:45:55.299972 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:55.299921    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:45:55.662235 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:55.662142    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx" podUID="12e54a59-313c-4e8e-b56b-a9a4aed3be8b"
Jul 03 09:45:55.798245 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:55.798219    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:45:58.681671 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:58.681630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:45:58.682122 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:45:58.681678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:45:58.682122 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:58.681811    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 03 09:45:58.682122 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:58.681829    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:45:58.682122 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:58.681832    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cdc6dd77d-mc878: secret "image-registry-tls" not found
Jul 03 09:45:58.682122 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:58.681890    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls podName:8274ca7d-200c-4e1d-af67-ed18b9c332be nodeName:}" failed. No retries permitted until 2026-07-03 09:48:00.68187355 +0000 UTC m=+284.850348929 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls") pod "image-registry-cdc6dd77d-mc878" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be") : secret "image-registry-tls" not found
Jul 03 09:45:58.682122 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:45:58.681904    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls podName:cd9d1bfd-444a-4357-b5af-2c8ad6e0af57 nodeName:}" failed. No retries permitted until 2026-07-03 09:48:00.681898131 +0000 UTC m=+284.850373510 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls") pod "dns-default-whxmx" (UID: "cd9d1bfd-444a-4357-b5af-2c8ad6e0af57") : secret "dns-default-metrics-tls" not found
Jul 03 09:46:00.592402 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:46:00.592350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:46:00.592803 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:46:00.592476    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 03 09:46:00.592803 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:46:00.592528    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert podName:12e54a59-313c-4e8e-b56b-a9a4aed3be8b nodeName:}" failed. No retries permitted until 2026-07-03 09:48:02.592515029 +0000 UTC m=+286.760990407 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bs5kx" (UID: "12e54a59-313c-4e8e-b56b-a9a4aed3be8b") : secret "networking-console-plugin-cert" not found
Jul 03 09:46:08.283972 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:46:08.283890    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:47:28.242683 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:28.242641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:47:28.243167 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:28.242802    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 09:47:28.243167 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:28.242867    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs podName:23aaea9d-d419-4085-a82f-e6f8f296d15d nodeName:}" failed. No retries permitted until 2026-07-03 09:49:30.242848026 +0000 UTC m=+374.411323408 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs") pod "network-metrics-daemon-5dtvh" (UID: "23aaea9d-d419-4085-a82f-e6f8f296d15d") : secret "metrics-daemon-secret" not found
Jul 03 09:47:42.328430 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.328339    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" podStartSLOduration=160.913649788 podStartE2EDuration="2m44.32831898s" totalImagesPullingTime="3.414669192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:45:02.6768258 +0000 UTC m=+106.845301201" watchObservedRunningTime="2026-07-03 09:47:42.32831898 +0000 UTC m=+266.496794380"
Jul 03 09:47:42.328919 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.328901    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8g4vq"]
Jul 03 09:47:42.331629 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.331610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.334291 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.334268    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 03 09:47:42.334385 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.334278    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 03 09:47:42.334944 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.334923    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c78n8\""
Jul 03 09:47:42.335041 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.335024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 03 09:47:42.335308 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.335287    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 03 09:47:42.345388 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.345369    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8g4vq"]
Jul 03 09:47:42.443328 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.443298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.443508 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.443332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d9tx\" (UniqueName: \"kubernetes.io/projected/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-api-access-2d9tx\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.443508 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.443428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6f1b368-dc3a-49be-9757-d865d5534a2a-data-volume\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.443508 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.443456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6f1b368-dc3a-49be-9757-d865d5534a2a-crio-socket\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.443508 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.443474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.543829 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.543792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6f1b368-dc3a-49be-9757-d865d5534a2a-data-volume\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.543829 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.543830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6f1b368-dc3a-49be-9757-d865d5534a2a-crio-socket\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.544023 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.543848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.544023 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.543924    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6f1b368-dc3a-49be-9757-d865d5534a2a-crio-socket\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.544023 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.543944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.544023 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:42.543932    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:42.544023 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.543979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d9tx\" (UniqueName: \"kubernetes.io/projected/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-api-access-2d9tx\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.544023 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:42.543973    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 09:47:42.544279 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:42.544025    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:43.04401247 +0000 UTC m=+267.212487849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:42.544279 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:42.544128    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:43.044107422 +0000 UTC m=+267.212582817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : configmap "kube-rbac-proxy" not found
Jul 03 09:47:42.544279 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.544129    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6f1b368-dc3a-49be-9757-d865d5534a2a-data-volume\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:42.552015 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:42.551992    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d9tx\" (UniqueName: \"kubernetes.io/projected/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-api-access-2d9tx\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:43.047933 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:43.047889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:43.048121 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:43.047990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:43.048121 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:43.048016    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 09:47:43.048121 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:43.048079    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:43.048121 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:43.048083    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:44.048069478 +0000 UTC m=+268.216544858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : configmap "kube-rbac-proxy" not found
Jul 03 09:47:43.048261 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:43.048127    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:44.048115102 +0000 UTC m=+268.216590480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:44.055859 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:44.055825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:44.055859 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:44.055866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:44.056262 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:44.055980    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 09:47:44.056262 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:44.056033    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:46.056020428 +0000 UTC m=+270.224495807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : configmap "kube-rbac-proxy" not found
Jul 03 09:47:44.056262 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:44.055978    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:44.056262 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:44.056107    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:46.056095399 +0000 UTC m=+270.224570790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:45.315059 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:45.315035    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwcx7_7b7191e6-3c30-4786-a757-291e3a630ae7/dns-node-resolver/0.log"
Jul 03 09:47:46.070821 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:46.070784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:46.070821 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:46.070826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:46.071037 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:46.070895    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 09:47:46.071037 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:46.070928    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:46.071037 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:46.070946    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:50.070933812 +0000 UTC m=+274.239409191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : configmap "kube-rbac-proxy" not found
Jul 03 09:47:46.071037 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:46.070992    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:50.070979229 +0000 UTC m=+274.239454611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:46.115035 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:46.115007    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x8wnj_96389e34-4e65-414b-9ab5-7fdba62634ad/node-ca/0.log"
Jul 03 09:47:46.915319 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:46.915290    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jtcvp_903f85b0-1190-487a-87db-8ef46a6bd144/serve-healthcheck-canary/0.log"
Jul 03 09:47:50.100330 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:50.100280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:50.100330 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:50.100337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:50.100798 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:50.100456    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:50.100798 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:50.100526    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls podName:f6f1b368-dc3a-49be-9757-d865d5534a2a nodeName:}" failed. No retries permitted until 2026-07-03 09:47:58.100508387 +0000 UTC m=+282.268983771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8g4vq" (UID: "f6f1b368-dc3a-49be-9757-d865d5534a2a") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:50.100959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:50.100940    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6f1b368-dc3a-49be-9757-d865d5534a2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:56.790421 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:56.790374    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" podUID="8274ca7d-200c-4e1d-af67-ed18b9c332be"
Jul 03 09:47:57.128616 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:57.128537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:47:57.796556 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:57.796500    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-whxmx" podUID="cd9d1bfd-444a-4357-b5af-2c8ad6e0af57"
Jul 03 09:47:58.131744 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:58.131659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whxmx"
Jul 03 09:47:58.164394 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:58.164366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:58.166562 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:58.166541    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6f1b368-dc3a-49be-9757-d865d5534a2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8g4vq\" (UID: \"f6f1b368-dc3a-49be-9757-d865d5534a2a\") " pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:58.241316 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:58.241297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8g4vq"
Jul 03 09:47:58.358651 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:58.358621    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8g4vq"]
Jul 03 09:47:58.362264 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:47:58.362229    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f1b368_dc3a_49be_9757_d865d5534a2a.slice/crio-5278524c0c7d4a424e6ad93f7753eab98ab8c325a7f772f6375e6f90a43ecde4 WatchSource:0}: Error finding container 5278524c0c7d4a424e6ad93f7753eab98ab8c325a7f772f6375e6f90a43ecde4: Status 404 returned error can't find the container with id 5278524c0c7d4a424e6ad93f7753eab98ab8c325a7f772f6375e6f90a43ecde4
Jul 03 09:47:58.798947 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:47:58.798911    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx" podUID="12e54a59-313c-4e8e-b56b-a9a4aed3be8b"
Jul 03 09:47:59.136942 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:59.136869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:47:59.137207 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:47:59.137164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8g4vq" event={"ID":"f6f1b368-dc3a-49be-9757-d865d5534a2a","Type":"ContainerStarted","Data":"5278524c0c7d4a424e6ad93f7753eab98ab8c325a7f772f6375e6f90a43ecde4"}
Jul 03 09:48:00.685659 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:00.685612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:48:00.686132 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:00.685674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:48:00.688288 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:00.688260    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd9d1bfd-444a-4357-b5af-2c8ad6e0af57-metrics-tls\") pod \"dns-default-whxmx\" (UID: \"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57\") " pod="openshift-dns/dns-default-whxmx"
Jul 03 09:48:00.688430 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:00.688302    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"image-registry-cdc6dd77d-mc878\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") " pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:48:00.732050 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:00.732026    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jhcf\""
Jul 03 09:48:00.739878 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:00.739856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:48:00.835857 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:00.835828    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ckvl\""
Jul 03 09:48:00.842995 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:00.842972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whxmx"
Jul 03 09:48:02.059344 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.059316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cdc6dd77d-mc878"]
Jul 03 09:48:02.062661 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:48:02.062640    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8274ca7d_200c_4e1d_af67_ed18b9c332be.slice/crio-0e7ec00c8080fa9acec742acca253bb2fb809dc1e5f3a2d9f7657c9dfb7fde99 WatchSource:0}: Error finding container 0e7ec00c8080fa9acec742acca253bb2fb809dc1e5f3a2d9f7657c9dfb7fde99: Status 404 returned error can't find the container with id 0e7ec00c8080fa9acec742acca253bb2fb809dc1e5f3a2d9f7657c9dfb7fde99
Jul 03 09:48:02.074618 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.074597    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whxmx"]
Jul 03 09:48:02.077657 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:48:02.077628    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9d1bfd_444a_4357_b5af_2c8ad6e0af57.slice/crio-d8e0e094c8a1d0df2b76d2bb089808fc497f540ef04a4a90904f0db75d029709 WatchSource:0}: Error finding container d8e0e094c8a1d0df2b76d2bb089808fc497f540ef04a4a90904f0db75d029709: Status 404 returned error can't find the container with id d8e0e094c8a1d0df2b76d2bb089808fc497f540ef04a4a90904f0db75d029709
Jul 03 09:48:02.146430 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.146391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whxmx" event={"ID":"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57","Type":"ContainerStarted","Data":"d8e0e094c8a1d0df2b76d2bb089808fc497f540ef04a4a90904f0db75d029709"}
Jul 03 09:48:02.147754 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.147716    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" event={"ID":"8274ca7d-200c-4e1d-af67-ed18b9c332be","Type":"ContainerStarted","Data":"286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89"}
Jul 03 09:48:02.147857 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.147770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" event={"ID":"8274ca7d-200c-4e1d-af67-ed18b9c332be","Type":"ContainerStarted","Data":"0e7ec00c8080fa9acec742acca253bb2fb809dc1e5f3a2d9f7657c9dfb7fde99"}
Jul 03 09:48:02.147857 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.147843    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:48:02.149060 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.149041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8g4vq" event={"ID":"f6f1b368-dc3a-49be-9757-d865d5534a2a","Type":"ContainerStarted","Data":"bcd8600c9b5142794d1327f4fc444969bc2a04115147d9e7b6f17b9c8fa26f6a"}
Jul 03 09:48:02.168032 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.167977    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" podStartSLOduration=285.167965032 podStartE2EDuration="4m45.167965032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:02.167130353 +0000 UTC m=+286.335605758" watchObservedRunningTime="2026-07-03 09:48:02.167965032 +0000 UTC m=+286.336440427"
Jul 03 09:48:02.603190 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.603148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:48:02.605757 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.605720    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12e54a59-313c-4e8e-b56b-a9a4aed3be8b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bs5kx\" (UID: \"12e54a59-313c-4e8e-b56b-a9a4aed3be8b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:48:02.739753 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.739716    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ttsjk\""
Jul 03 09:48:02.747545 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.747520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"
Jul 03 09:48:02.884318 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:02.884235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx"]
Jul 03 09:48:02.887908 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:48:02.887881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e54a59_313c_4e8e_b56b_a9a4aed3be8b.slice/crio-1acb1a37c0092c8769c402b38e119fa43a41f0f003b274c503ac5f1e45f14e57 WatchSource:0}: Error finding container 1acb1a37c0092c8769c402b38e119fa43a41f0f003b274c503ac5f1e45f14e57: Status 404 returned error can't find the container with id 1acb1a37c0092c8769c402b38e119fa43a41f0f003b274c503ac5f1e45f14e57
Jul 03 09:48:03.154200 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:03.154111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8g4vq" event={"ID":"f6f1b368-dc3a-49be-9757-d865d5534a2a","Type":"ContainerStarted","Data":"d239aac6592f5b7852ff640acefdad77a50229dab29763dab8d2e4998e550c64"}
Jul 03 09:48:03.155383 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:03.155354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx" event={"ID":"12e54a59-313c-4e8e-b56b-a9a4aed3be8b","Type":"ContainerStarted","Data":"1acb1a37c0092c8769c402b38e119fa43a41f0f003b274c503ac5f1e45f14e57"}
Jul 03 09:48:06.167117 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:06.167081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx" event={"ID":"12e54a59-313c-4e8e-b56b-a9a4aed3be8b","Type":"ContainerStarted","Data":"9061fc43df55d8864032ac033bb9e4c46a119890262cb458b34d798eb1101798"}
Jul 03 09:48:06.168810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:06.168787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whxmx" event={"ID":"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57","Type":"ContainerStarted","Data":"1e103d105a5cb50f6fc99a14661be36d06599732c4445f20ebbca3ff2efb8b03"}
Jul 03 09:48:06.168936 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:06.168834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whxmx" event={"ID":"cd9d1bfd-444a-4357-b5af-2c8ad6e0af57","Type":"ContainerStarted","Data":"aef5551819d82c5a2a5a89a3201d043b611e9ca60dcbbd686546b2bb9eb149bb"}
Jul 03 09:48:06.168936 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:06.168862    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-whxmx"
Jul 03 09:48:06.170533 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:06.170513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8g4vq" event={"ID":"f6f1b368-dc3a-49be-9757-d865d5534a2a","Type":"ContainerStarted","Data":"6c3ad3d0d1766f9508b3316df473cb13300c520e73b71a191b423acf4bb9ba4a"}
Jul 03 09:48:06.183535 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:06.183495    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bs5kx" podStartSLOduration=251.70114793 podStartE2EDuration="4m14.183481403s" totalImagesPullingTime="2.482333473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:06.182428709 +0000 UTC m=+290.350904093" watchObservedRunningTime="2026-07-03 09:48:06.183481403 +0000 UTC m=+290.351956805"
Jul 03 09:48:06.201152 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:06.201112    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-whxmx" podStartSLOduration=252.908183242 podStartE2EDuration="4m16.201099202s" totalImagesPullingTime="3.29291596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:06.200413327 +0000 UTC m=+290.368888742" watchObservedRunningTime="2026-07-03 09:48:06.201099202 +0000 UTC m=+290.369574603"
Jul 03 09:48:06.218437 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:06.218388    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8g4vq" podStartSLOduration=17.276605739 podStartE2EDuration="24.218377174s" totalImagesPullingTime="6.941771435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:47:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:06.217079659 +0000 UTC m=+290.385555050" watchObservedRunningTime="2026-07-03 09:48:06.218377174 +0000 UTC m=+290.386852573"
Jul 03 09:48:11.285230 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:48:11.285185    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5dtvh" podUID="23aaea9d-d419-4085-a82f-e6f8f296d15d"
Jul 03 09:48:16.175876 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:16.175848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-whxmx"
Jul 03 09:48:16.194516 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:16.194490    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 03 09:48:18.487058 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.487029    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2gf4n"]
Jul 03 09:48:18.490491 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.490475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.492838 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.492817    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w64h7\""
Jul 03 09:48:18.492926 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.492821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 03 09:48:18.493135 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.493119    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 03 09:48:18.493592 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.493565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 03 09:48:18.493686 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.493662    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 03 09:48:18.493747 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.493709    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 03 09:48:18.493790 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.493766    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 03 09:48:18.611728 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.611888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-wtmp\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.611888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/946db8b0-ca83-4416-9793-8201f2645091-metrics-client-ca\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.611888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-accelerators-collector-config\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.611888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-sys\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.611888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-tls\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.611888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-textfile\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.612078 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfqf6\" (UniqueName: \"kubernetes.io/projected/946db8b0-ca83-4416-9793-8201f2645091-kube-api-access-wfqf6\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.612078 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.611964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-root\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713134 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-root\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-wtmp\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713226    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-root\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/946db8b0-ca83-4416-9793-8201f2645091-metrics-client-ca\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713293 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713285    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-wtmp\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713527 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-accelerators-collector-config\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713527 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-sys\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713527 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713344    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/946db8b0-ca83-4416-9793-8201f2645091-sys\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713527 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-tls\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713527 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-textfile\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713527 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:48:18.713501    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 03 09:48:18.713849 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfqf6\" (UniqueName: \"kubernetes.io/projected/946db8b0-ca83-4416-9793-8201f2645091-kube-api-access-wfqf6\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.713849 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:48:18.713579    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-tls podName:946db8b0-ca83-4416-9793-8201f2645091 nodeName:}" failed. No retries permitted until 2026-07-03 09:48:19.213558737 +0000 UTC m=+303.382034122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-tls") pod "node-exporter-2gf4n" (UID: "946db8b0-ca83-4416-9793-8201f2645091") : secret "node-exporter-tls" not found
Jul 03 09:48:18.713849 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713710    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-textfile\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.714013 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713946    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/946db8b0-ca83-4416-9793-8201f2645091-metrics-client-ca\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.714013 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.713959    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-accelerators-collector-config\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.715496 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.715476    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:18.723000 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:18.722982    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfqf6\" (UniqueName: \"kubernetes.io/projected/946db8b0-ca83-4416-9793-8201f2645091-kube-api-access-wfqf6\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:19.216466 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.216433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-tls\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:19.218637 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.218617    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/946db8b0-ca83-4416-9793-8201f2645091-node-exporter-tls\") pod \"node-exporter-2gf4n\" (UID: \"946db8b0-ca83-4416-9793-8201f2645091\") " pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:19.399710 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.399680    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2gf4n"
Jul 03 09:48:19.413998 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:48:19.413973    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946db8b0_ca83_4416_9793_8201f2645091.slice/crio-d434982fc8c06e237d2ae3fa9e6baa301015088398321024e303e2eaa00905f7 WatchSource:0}: Error finding container d434982fc8c06e237d2ae3fa9e6baa301015088398321024e303e2eaa00905f7: Status 404 returned error can't find the container with id d434982fc8c06e237d2ae3fa9e6baa301015088398321024e303e2eaa00905f7
Jul 03 09:48:19.415593 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.415578    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 09:48:19.533192 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.533168    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:48:19.537286 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.537271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.540035 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540016    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dzzb5\""
Jul 03 09:48:19.540243 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540221    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 03 09:48:19.540243 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540234    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 03 09:48:19.540396 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540253    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 03 09:48:19.540396 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540272    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 03 09:48:19.540396 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540336    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 03 09:48:19.540576 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540563    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 03 09:48:19.540576 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540571    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 03 09:48:19.540684 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540597    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 03 09:48:19.540684 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.540620    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 03 09:48:19.555663 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.555640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:48:19.619244 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-out\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619244 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619385 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619385 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619385 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619385 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619385 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619550 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-web-config\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619550 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg7xm\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-kube-api-access-lg7xm\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619550 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619550 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619550 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.619708 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.619577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720548 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720548 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720548 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-web-config\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720548 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg7xm\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-kube-api-access-lg7xm\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720548 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720847 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720514    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720847 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:48:19.720609    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle podName:b3d7a825-cd2f-47f7-8035-4652282d1aba nodeName:}" failed. No retries permitted until 2026-07-03 09:48:20.220590441 +0000 UTC m=+304.389065820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba") : configmap references non-existent config key: ca-bundle.crt
Jul 03 09:48:19.720847 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720847 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720847 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-out\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720847 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720847 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.720847 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.720844    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.721243 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.721194    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.723800 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.723491    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.723800 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.723558    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-out\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.723800 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.723591    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.723800 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.723616    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.723800 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.723702    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-web-config\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.724110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.723815    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.724110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.723992    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.724210 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.724108    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.725328 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.725308    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:19.729107 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:19.729087    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg7xm\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-kube-api-access-lg7xm\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:20.215155 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:20.215099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2gf4n" event={"ID":"946db8b0-ca83-4416-9793-8201f2645091","Type":"ContainerStarted","Data":"d434982fc8c06e237d2ae3fa9e6baa301015088398321024e303e2eaa00905f7"}
Jul 03 09:48:20.223425 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:20.223395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:20.224311 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:20.224287    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:20.446050 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:20.446016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:48:20.577698 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:20.577609    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:48:20.579991 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:48:20.579963    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d7a825_cd2f_47f7_8035_4652282d1aba.slice/crio-f58e9be302e669479d8abb143508e5bed6d8450710fdc3d8714b31f30a57b17b WatchSource:0}: Error finding container f58e9be302e669479d8abb143508e5bed6d8450710fdc3d8714b31f30a57b17b: Status 404 returned error can't find the container with id f58e9be302e669479d8abb143508e5bed6d8450710fdc3d8714b31f30a57b17b
Jul 03 09:48:20.744756 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:20.744656    2580 patch_prober.go:28] interesting pod/image-registry-cdc6dd77d-mc878 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 03 09:48:20.744756 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:20.744710    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" podUID="8274ca7d-200c-4e1d-af67-ed18b9c332be" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 03 09:48:21.220455 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:21.220422    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerStarted","Data":"f58e9be302e669479d8abb143508e5bed6d8450710fdc3d8714b31f30a57b17b"}
Jul 03 09:48:21.222158 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:21.222131    2580 generic.go:356] "Generic (PLEG): container finished" podID="946db8b0-ca83-4416-9793-8201f2645091" containerID="78a201d76315ea0cfdcde0b815433bc8b8968b41b3739a7e2903ee475ac0624e" exitCode=0
Jul 03 09:48:21.222262 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:21.222180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2gf4n" event={"ID":"946db8b0-ca83-4416-9793-8201f2645091","Type":"ContainerDied","Data":"78a201d76315ea0cfdcde0b815433bc8b8968b41b3739a7e2903ee475ac0624e"}
Jul 03 09:48:22.227642 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:22.227604    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2gf4n" event={"ID":"946db8b0-ca83-4416-9793-8201f2645091","Type":"ContainerStarted","Data":"fcb1a3eab4e622a4f191f428d86f0f918ef494e3e3ba972da3a8230e78e1c62c"}
Jul 03 09:48:22.228097 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:22.227715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2gf4n" event={"ID":"946db8b0-ca83-4416-9793-8201f2645091","Type":"ContainerStarted","Data":"91356113eaf51d28381b42f598f766925ed84588ba88c7a319cb9bd79e2eba90"}
Jul 03 09:48:22.229170 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:22.229143    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerID="2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3" exitCode=0
Jul 03 09:48:22.229268 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:22.229179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerDied","Data":"2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3"}
Jul 03 09:48:22.246918 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:22.246877    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2gf4n" podStartSLOduration=3.271866018 podStartE2EDuration="4.246863221s" totalImagesPullingTime="913.363602ms" totalInitContainerRuntime="61.633601ms" isStatefulPod=true podCreationTimestamp="2026-07-03 09:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:22.24558122 +0000 UTC m=+306.414056621" watchObservedRunningTime="2026-07-03 09:48:22.246863221 +0000 UTC m=+306.415338620"
Jul 03 09:48:22.284638 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:22.284612    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:48:23.161075 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:23.161046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:48:24.240936 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:24.240862    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerStarted","Data":"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55"}
Jul 03 09:48:24.240936 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:24.240923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerStarted","Data":"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90"}
Jul 03 09:48:24.241298 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:24.240949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerStarted","Data":"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856"}
Jul 03 09:48:24.241298 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:24.240973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerStarted","Data":"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521"}
Jul 03 09:48:24.241298 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:24.240995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerStarted","Data":"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc"}
Jul 03 09:48:25.247805 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:25.247715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerStarted","Data":"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2"}
Jul 03 09:48:25.280795 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:25.280749    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.775846537 podStartE2EDuration="6.280716159s" totalImagesPullingTime="3.485391177s" totalInitContainerRuntime="19.478445ms" isStatefulPod=false podCreationTimestamp="2026-07-03 09:48:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:25.279914262 +0000 UTC m=+309.448389664" watchObservedRunningTime="2026-07-03 09:48:25.280716159 +0000 UTC m=+309.449191560"
Jul 03 09:48:30.589453 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:30.589418    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cdc6dd77d-mc878"]
Jul 03 09:48:34.078751 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.078710    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-6f9lm"]
Jul 03 09:48:34.086455 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.086432    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6f9lm"
Jul 03 09:48:34.089413 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.089387    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 03 09:48:34.089539 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.089400    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 03 09:48:34.089820 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.089801    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zg78l\""
Jul 03 09:48:34.092248 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.092230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6f9lm"]
Jul 03 09:48:34.231490 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.231458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lncms\" (UniqueName: \"kubernetes.io/projected/c679a260-f650-4d55-8af5-080c507e3232-kube-api-access-lncms\") pod \"downloads-685bfb5f64-6f9lm\" (UID: \"c679a260-f650-4d55-8af5-080c507e3232\") " pod="openshift-console/downloads-685bfb5f64-6f9lm"
Jul 03 09:48:34.332362 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.332281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lncms\" (UniqueName: \"kubernetes.io/projected/c679a260-f650-4d55-8af5-080c507e3232-kube-api-access-lncms\") pod \"downloads-685bfb5f64-6f9lm\" (UID: \"c679a260-f650-4d55-8af5-080c507e3232\") " pod="openshift-console/downloads-685bfb5f64-6f9lm"
Jul 03 09:48:34.340507 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.340483    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lncms\" (UniqueName: \"kubernetes.io/projected/c679a260-f650-4d55-8af5-080c507e3232-kube-api-access-lncms\") pod \"downloads-685bfb5f64-6f9lm\" (UID: \"c679a260-f650-4d55-8af5-080c507e3232\") " pod="openshift-console/downloads-685bfb5f64-6f9lm"
Jul 03 09:48:34.395577 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.395550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-6f9lm"
Jul 03 09:48:34.519899 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:34.519818    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-6f9lm"]
Jul 03 09:48:34.522435 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:48:34.522397    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc679a260_f650_4d55_8af5_080c507e3232.slice/crio-b74247891904ec6f468c7189f8c497427a132b0e44f02a1642958d1efd33994c WatchSource:0}: Error finding container b74247891904ec6f468c7189f8c497427a132b0e44f02a1642958d1efd33994c: Status 404 returned error can't find the container with id b74247891904ec6f468c7189f8c497427a132b0e44f02a1642958d1efd33994c
Jul 03 09:48:35.282750 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:35.282681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6f9lm" event={"ID":"c679a260-f650-4d55-8af5-080c507e3232","Type":"ContainerStarted","Data":"b74247891904ec6f468c7189f8c497427a132b0e44f02a1642958d1efd33994c"}
Jul 03 09:48:48.806906 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:48.806863    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" podUID="e17c3cf6-7444-419a-b636-dae96fb9c71a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 03 09:48:51.342467 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:51.342425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-6f9lm" event={"ID":"c679a260-f650-4d55-8af5-080c507e3232","Type":"ContainerStarted","Data":"3ccb7a76d86b3084802ab3af809af0c164f974d4d9588003994f7fbbd35dcbdd"}
Jul 03 09:48:51.342953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:51.342640    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-6f9lm"
Jul 03 09:48:51.358337 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:51.358313    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-6f9lm"
Jul 03 09:48:51.362097 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:51.362050    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-6f9lm" podStartSLOduration=0.967582734 podStartE2EDuration="17.362035802s" totalImagesPullingTime="16.394453068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:51.360424146 +0000 UTC m=+335.528899552" watchObservedRunningTime="2026-07-03 09:48:51.362035802 +0000 UTC m=+335.530511254"
Jul 03 09:48:52.990451 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:52.990414    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66c76c79ff-hpnjc"]
Jul 03 09:48:53.021419 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.021387    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c76c79ff-hpnjc"]
Jul 03 09:48:53.021572 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.021492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.024304 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.024275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 03 09:48:53.024419 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.024279    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 03 09:48:53.024996 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.024951    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-62tn6\""
Jul 03 09:48:53.024996 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.024969    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 03 09:48:53.025150 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.025030    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 03 09:48:53.025465 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.025440    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 03 09:48:53.029405 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.029380    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 03 09:48:53.094053 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.094015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-oauth-config\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.094234 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.094067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-config\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.094234 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.094173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzf64\" (UniqueName: \"kubernetes.io/projected/ff316bed-c9fd-4f05-a2b1-20efc8d03275-kube-api-access-tzf64\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.094234 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.094215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-trusted-ca-bundle\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.094403 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.094295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-oauth-serving-cert\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.094403 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.094370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-serving-cert\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.094522 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.094421    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-service-ca\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.195530 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.195493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-serving-cert\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.195708 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.195540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-service-ca\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.195708 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.195590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-oauth-config\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.195708 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.195617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-config\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.195708 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.195651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzf64\" (UniqueName: \"kubernetes.io/projected/ff316bed-c9fd-4f05-a2b1-20efc8d03275-kube-api-access-tzf64\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.195708 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.195678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-trusted-ca-bundle\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.196009 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.195756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-oauth-serving-cert\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.197269 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.196547    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-config\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.197269 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.196627    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-oauth-serving-cert\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.197269 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.196712    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-trusted-ca-bundle\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.197269 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.197237    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-service-ca\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.198428 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.198393    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-oauth-config\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.198547 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.198533    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-serving-cert\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.206643 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.206600    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzf64\" (UniqueName: \"kubernetes.io/projected/ff316bed-c9fd-4f05-a2b1-20efc8d03275-kube-api-access-tzf64\") pod \"console-66c76c79ff-hpnjc\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") " pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.333445 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.333411    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:48:53.510710 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:53.510606    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66c76c79ff-hpnjc"]
Jul 03 09:48:53.514862 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:48:53.514831    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff316bed_c9fd_4f05_a2b1_20efc8d03275.slice/crio-27cd912a8fd7164bccae879f29979340531297334c6d6dd7b82795b162129961 WatchSource:0}: Error finding container 27cd912a8fd7164bccae879f29979340531297334c6d6dd7b82795b162129961: Status 404 returned error can't find the container with id 27cd912a8fd7164bccae879f29979340531297334c6d6dd7b82795b162129961
Jul 03 09:48:54.355890 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:54.355799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c76c79ff-hpnjc" event={"ID":"ff316bed-c9fd-4f05-a2b1-20efc8d03275","Type":"ContainerStarted","Data":"27cd912a8fd7164bccae879f29979340531297334c6d6dd7b82795b162129961"}
Jul 03 09:48:55.609587 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:55.609468    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" podUID="8274ca7d-200c-4e1d-af67-ed18b9c332be" containerName="registry" containerID="cri-o://286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89" gracePeriod=30
Jul 03 09:48:56.924619 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:56.924589    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:48:57.034676 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.034645    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g75s9\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-kube-api-access-g75s9\") pod \"8274ca7d-200c-4e1d-af67-ed18b9c332be\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") "
Jul 03 09:48:57.034915 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.034684    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") pod \"8274ca7d-200c-4e1d-af67-ed18b9c332be\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") "
Jul 03 09:48:57.034915 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.034835    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8274ca7d-200c-4e1d-af67-ed18b9c332be-ca-trust-extracted\") pod \"8274ca7d-200c-4e1d-af67-ed18b9c332be\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") "
Jul 03 09:48:57.034915 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.034908    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-image-registry-private-configuration\") pod \"8274ca7d-200c-4e1d-af67-ed18b9c332be\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") "
Jul 03 09:48:57.035091 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.034936    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-installation-pull-secrets\") pod \"8274ca7d-200c-4e1d-af67-ed18b9c332be\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") "
Jul 03 09:48:57.035091 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.034984    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-trusted-ca\") pod \"8274ca7d-200c-4e1d-af67-ed18b9c332be\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") "
Jul 03 09:48:57.035091 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.035027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-bound-sa-token\") pod \"8274ca7d-200c-4e1d-af67-ed18b9c332be\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") "
Jul 03 09:48:57.035091 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.035056    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-certificates\") pod \"8274ca7d-200c-4e1d-af67-ed18b9c332be\" (UID: \"8274ca7d-200c-4e1d-af67-ed18b9c332be\") "
Jul 03 09:48:57.035821 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.035549    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8274ca7d-200c-4e1d-af67-ed18b9c332be" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:48:57.035821 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.035627    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8274ca7d-200c-4e1d-af67-ed18b9c332be" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:48:57.038039 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.038013    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8274ca7d-200c-4e1d-af67-ed18b9c332be" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:48:57.038140 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.038120    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8274ca7d-200c-4e1d-af67-ed18b9c332be" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:48:57.038821 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.038788    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8274ca7d-200c-4e1d-af67-ed18b9c332be" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:48:57.038938 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.038841    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-kube-api-access-g75s9" (OuterVolumeSpecName: "kube-api-access-g75s9") pod "8274ca7d-200c-4e1d-af67-ed18b9c332be" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be"). InnerVolumeSpecName "kube-api-access-g75s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:48:57.038938 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.038906    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8274ca7d-200c-4e1d-af67-ed18b9c332be" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:48:57.045957 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.045929    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8274ca7d-200c-4e1d-af67-ed18b9c332be-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8274ca7d-200c-4e1d-af67-ed18b9c332be" (UID: "8274ca7d-200c-4e1d-af67-ed18b9c332be"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:48:57.136580 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.136544    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-image-registry-private-configuration\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:48:57.136580 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.136576    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8274ca7d-200c-4e1d-af67-ed18b9c332be-installation-pull-secrets\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:48:57.136835 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.136593    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-trusted-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:48:57.136835 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.136607    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-bound-sa-token\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:48:57.136835 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.136619    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-certificates\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:48:57.136835 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.136633    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g75s9\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-kube-api-access-g75s9\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:48:57.136835 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.136642    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8274ca7d-200c-4e1d-af67-ed18b9c332be-registry-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:48:57.136835 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.136653    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8274ca7d-200c-4e1d-af67-ed18b9c332be-ca-trust-extracted\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:48:57.370677 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.370580    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c76c79ff-hpnjc" event={"ID":"ff316bed-c9fd-4f05-a2b1-20efc8d03275","Type":"ContainerStarted","Data":"b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9"}
Jul 03 09:48:57.372266 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.372236    2580 generic.go:356] "Generic (PLEG): container finished" podID="8274ca7d-200c-4e1d-af67-ed18b9c332be" containerID="286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89" exitCode=0
Jul 03 09:48:57.372395 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.372273    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878"
Jul 03 09:48:57.372395 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.372292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" event={"ID":"8274ca7d-200c-4e1d-af67-ed18b9c332be","Type":"ContainerDied","Data":"286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89"}
Jul 03 09:48:57.372395 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.372332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cdc6dd77d-mc878" event={"ID":"8274ca7d-200c-4e1d-af67-ed18b9c332be","Type":"ContainerDied","Data":"0e7ec00c8080fa9acec742acca253bb2fb809dc1e5f3a2d9f7657c9dfb7fde99"}
Jul 03 09:48:57.372395 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.372358    2580 scope.go:117] "RemoveContainer" containerID="286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89"
Jul 03 09:48:57.381810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.381788    2580 scope.go:117] "RemoveContainer" containerID="286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89"
Jul 03 09:48:57.382114 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:48:57.382091    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89\": container with ID starting with 286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89 not found: ID does not exist" containerID="286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89"
Jul 03 09:48:57.382201 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.382124    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89"} err="failed to get container status \"286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89\": rpc error: code = NotFound desc = could not find container \"286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89\": container with ID starting with 286937e0351a3f56a7b6b7bae9d09a8ab9463b4d863a32d046edb10a6c9abc89 not found: ID does not exist"
Jul 03 09:48:57.389800 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.389752    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66c76c79ff-hpnjc" podStartSLOduration=1.75080148 podStartE2EDuration="5.389719822s" totalImagesPullingTime="3.638918342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:57.389163939 +0000 UTC m=+341.557639366" watchObservedRunningTime="2026-07-03 09:48:57.389719822 +0000 UTC m=+341.558195224"
Jul 03 09:48:57.401567 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.401543    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cdc6dd77d-mc878"]
Jul 03 09:48:57.405360 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:57.405335    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cdc6dd77d-mc878"]
Jul 03 09:48:58.289651 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:58.289612    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8274ca7d-200c-4e1d-af67-ed18b9c332be" path="/var/lib/kubelet/pods/8274ca7d-200c-4e1d-af67-ed18b9c332be/volumes"
Jul 03 09:48:58.807120 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:48:58.807068    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" podUID="e17c3cf6-7444-419a-b636-dae96fb9c71a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 03 09:49:03.334100 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:03.334065    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:49:03.334571 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:03.334127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:49:03.338979 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:03.338956    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:49:03.396554 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:03.396531    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:49:08.807094 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:08.807014    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" podUID="e17c3cf6-7444-419a-b636-dae96fb9c71a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 03 09:49:08.807094 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:08.807091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc"
Jul 03 09:49:08.807532 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:08.807520    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"62f1c38e9a119022a05d591a106a99e73f6dd64b1d81bb41c320c5b5b81ffe03"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 03 09:49:08.807610 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:08.807553    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" podUID="e17c3cf6-7444-419a-b636-dae96fb9c71a" containerName="service-proxy" containerID="cri-o://62f1c38e9a119022a05d591a106a99e73f6dd64b1d81bb41c320c5b5b81ffe03" gracePeriod=30
Jul 03 09:49:09.414686 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:09.414636    2580 generic.go:356] "Generic (PLEG): container finished" podID="e17c3cf6-7444-419a-b636-dae96fb9c71a" containerID="62f1c38e9a119022a05d591a106a99e73f6dd64b1d81bb41c320c5b5b81ffe03" exitCode=2
Jul 03 09:49:09.414894 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:09.414702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" event={"ID":"e17c3cf6-7444-419a-b636-dae96fb9c71a","Type":"ContainerDied","Data":"62f1c38e9a119022a05d591a106a99e73f6dd64b1d81bb41c320c5b5b81ffe03"}
Jul 03 09:49:09.414894 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:09.414766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7598d886c4-wjjcc" event={"ID":"e17c3cf6-7444-419a-b636-dae96fb9c71a","Type":"ContainerStarted","Data":"bb8a0d3c19298ca82f1685e4553c0fc3c90cd8575e7eca55db74ad83482f106b"}
Jul 03 09:49:30.298207 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:30.298171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:49:30.300341 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:30.300308    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23aaea9d-d419-4085-a82f-e6f8f296d15d-metrics-certs\") pod \"network-metrics-daemon-5dtvh\" (UID: \"23aaea9d-d419-4085-a82f-e6f8f296d15d\") " pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:49:30.388026 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:30.387999    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-98cbg\""
Jul 03 09:49:30.396146 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:30.396129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5dtvh"
Jul 03 09:49:30.554672 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:30.554602    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5dtvh"]
Jul 03 09:49:30.557555 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:49:30.557532    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23aaea9d_d419_4085_a82f_e6f8f296d15d.slice/crio-f306d67946bc324eb0e923a722d8b52067a1cc2b6df084544cb978d7c5a1d648 WatchSource:0}: Error finding container f306d67946bc324eb0e923a722d8b52067a1cc2b6df084544cb978d7c5a1d648: Status 404 returned error can't find the container with id f306d67946bc324eb0e923a722d8b52067a1cc2b6df084544cb978d7c5a1d648
Jul 03 09:49:31.498280 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:31.498247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dtvh" event={"ID":"23aaea9d-d419-4085-a82f-e6f8f296d15d","Type":"ContainerStarted","Data":"f306d67946bc324eb0e923a722d8b52067a1cc2b6df084544cb978d7c5a1d648"}
Jul 03 09:49:32.502972 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:32.502893    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dtvh" event={"ID":"23aaea9d-d419-4085-a82f-e6f8f296d15d","Type":"ContainerStarted","Data":"1f2c89e3b85cbdea845417ad695183a91af764884e6a28cae10af2121ed27cc7"}
Jul 03 09:49:32.502972 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:32.502948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5dtvh" event={"ID":"23aaea9d-d419-4085-a82f-e6f8f296d15d","Type":"ContainerStarted","Data":"71b4c316b78f71b9fe86f0671243c96853abcaad4107db24eb6f4fa56a9620ed"}
Jul 03 09:49:32.521150 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:32.521103    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5dtvh" podStartSLOduration=374.153397789 podStartE2EDuration="6m15.521087853s" totalImagesPullingTime="1.367690064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:49:32.520346836 +0000 UTC m=+376.688822238" watchObservedRunningTime="2026-07-03 09:49:32.521087853 +0000 UTC m=+376.689563257"
Jul 03 09:49:38.825397 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:38.825362    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:49:38.825927 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:38.825620    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="alertmanager" containerID="cri-o://2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc" gracePeriod=120
Jul 03 09:49:38.825927 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:38.825689    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy-metric" containerID="cri-o://ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55" gracePeriod=120
Jul 03 09:49:38.825927 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:38.825719    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy" containerID="cri-o://2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90" gracePeriod=120
Jul 03 09:49:38.825927 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:38.825690    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy-web" containerID="cri-o://88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856" gracePeriod=120
Jul 03 09:49:38.825927 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:38.825760    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="prom-label-proxy" containerID="cri-o://291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2" gracePeriod=120
Jul 03 09:49:38.825927 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:38.825774    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="config-reloader" containerID="cri-o://cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521" gracePeriod=120
Jul 03 09:49:39.532600 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:39.532562    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerID="291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2" exitCode=0
Jul 03 09:49:39.532600 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:39.532590    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerID="2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90" exitCode=0
Jul 03 09:49:39.532600 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:39.532596    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerID="cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521" exitCode=0
Jul 03 09:49:39.532600 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:39.532602    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerID="2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc" exitCode=0
Jul 03 09:49:39.532877 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:39.532631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerDied","Data":"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2"}
Jul 03 09:49:39.532877 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:39.532696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerDied","Data":"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90"}
Jul 03 09:49:39.532877 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:39.532722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerDied","Data":"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521"}
Jul 03 09:49:39.532877 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:39.532764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerDied","Data":"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc"}
Jul 03 09:49:40.063968 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.063944    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.164666 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164638    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-metrics-client-ca\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.164839 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164679    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-cluster-tls-config\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.164839 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164710    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg7xm\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-kube-api-access-lg7xm\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.164839 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164758    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-web-config\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.164839 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164786    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.164839 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164817    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-main-db\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.165110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164847    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-main-tls\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.165110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164874    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-out\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.165110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164908    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.165110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-volume\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.165110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164964    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-web\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.165110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.164993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-tls-assets\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.165110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.165016    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:40.165110 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.165031    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b3d7a825-cd2f-47f7-8035-4652282d1aba\" (UID: \"b3d7a825-cd2f-47f7-8035-4652282d1aba\") "
Jul 03 09:49:40.165530 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.165148    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:49:40.165530 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.165199    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:40.165530 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.165253    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-main-db\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.165530 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.165270    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-metrics-client-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.167596 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.167569    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-kube-api-access-lg7xm" (OuterVolumeSpecName: "kube-api-access-lg7xm") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "kube-api-access-lg7xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:49:40.167707 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.167674    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:40.167958 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.167933    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:40.168612 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.168573    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:40.168612 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.168581    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-out" (OuterVolumeSpecName: "config-out") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:49:40.168612 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.168595    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:40.169168 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.169148    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:49:40.169976 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.169917    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-volume" (OuterVolumeSpecName: "config-volume") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:40.172106 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.172084    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:40.177158 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.177137    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-web-config" (OuterVolumeSpecName: "web-config") pod "b3d7a825-cd2f-47f7-8035-4652282d1aba" (UID: "b3d7a825-cd2f-47f7-8035-4652282d1aba"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:40.265625 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265591    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265625 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265621    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-cluster-tls-config\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265635    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg7xm\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-kube-api-access-lg7xm\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265648    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-web-config\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265659    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3d7a825-cd2f-47f7-8035-4652282d1aba-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265673    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-main-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265685    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-out\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265697    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265709    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-config-volume\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265721    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3d7a825-cd2f-47f7-8035-4652282d1aba-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.265810 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.265756    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3d7a825-cd2f-47f7-8035-4652282d1aba-tls-assets\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:49:40.539496 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.539462    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerID="ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55" exitCode=0
Jul 03 09:49:40.539496 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.539492    2580 generic.go:356] "Generic (PLEG): container finished" podID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerID="88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856" exitCode=0
Jul 03 09:49:40.539677 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.539538    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.539677 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.539537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerDied","Data":"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55"}
Jul 03 09:49:40.539677 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.539601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerDied","Data":"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856"}
Jul 03 09:49:40.539677 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.539628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3d7a825-cd2f-47f7-8035-4652282d1aba","Type":"ContainerDied","Data":"f58e9be302e669479d8abb143508e5bed6d8450710fdc3d8714b31f30a57b17b"}
Jul 03 09:49:40.539677 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.539659    2580 scope.go:117] "RemoveContainer" containerID="291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2"
Jul 03 09:49:40.546885 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.546869    2580 scope.go:117] "RemoveContainer" containerID="ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55"
Jul 03 09:49:40.553051 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.553035    2580 scope.go:117] "RemoveContainer" containerID="2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90"
Jul 03 09:49:40.559436 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.559407    2580 scope.go:117] "RemoveContainer" containerID="88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856"
Jul 03 09:49:40.560068 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.560050    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:49:40.564965 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.564941    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:49:40.567309 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.567293    2580 scope.go:117] "RemoveContainer" containerID="cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521"
Jul 03 09:49:40.573604 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.573587    2580 scope.go:117] "RemoveContainer" containerID="2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc"
Jul 03 09:49:40.580172 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.580157    2580 scope.go:117] "RemoveContainer" containerID="2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3"
Jul 03 09:49:40.586338 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.586323    2580 scope.go:117] "RemoveContainer" containerID="291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2"
Jul 03 09:49:40.586576 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:49:40.586560    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2\": container with ID starting with 291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2 not found: ID does not exist" containerID="291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2"
Jul 03 09:49:40.586620 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.586584    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2"} err="failed to get container status \"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2\": rpc error: code = NotFound desc = could not find container \"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2\": container with ID starting with 291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2 not found: ID does not exist"
Jul 03 09:49:40.586620 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.586601    2580 scope.go:117] "RemoveContainer" containerID="ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55"
Jul 03 09:49:40.586869 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:49:40.586853    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55\": container with ID starting with ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55 not found: ID does not exist" containerID="ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55"
Jul 03 09:49:40.586918 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.586874    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55"} err="failed to get container status \"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55\": rpc error: code = NotFound desc = could not find container \"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55\": container with ID starting with ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55 not found: ID does not exist"
Jul 03 09:49:40.586918 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.586889    2580 scope.go:117] "RemoveContainer" containerID="2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90"
Jul 03 09:49:40.587133 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:49:40.587116    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90\": container with ID starting with 2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90 not found: ID does not exist" containerID="2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90"
Jul 03 09:49:40.587171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.587140    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90"} err="failed to get container status \"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90\": rpc error: code = NotFound desc = could not find container \"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90\": container with ID starting with 2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90 not found: ID does not exist"
Jul 03 09:49:40.587171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.587156    2580 scope.go:117] "RemoveContainer" containerID="88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856"
Jul 03 09:49:40.587418 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:49:40.587398    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856\": container with ID starting with 88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856 not found: ID does not exist" containerID="88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856"
Jul 03 09:49:40.587492 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.587426    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856"} err="failed to get container status \"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856\": rpc error: code = NotFound desc = could not find container \"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856\": container with ID starting with 88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856 not found: ID does not exist"
Jul 03 09:49:40.587492 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.587441    2580 scope.go:117] "RemoveContainer" containerID="cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521"
Jul 03 09:49:40.587675 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:49:40.587657    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521\": container with ID starting with cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521 not found: ID does not exist" containerID="cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521"
Jul 03 09:49:40.587715 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.587681    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521"} err="failed to get container status \"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521\": rpc error: code = NotFound desc = could not find container \"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521\": container with ID starting with cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521 not found: ID does not exist"
Jul 03 09:49:40.587715 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.587695    2580 scope.go:117] "RemoveContainer" containerID="2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc"
Jul 03 09:49:40.587954 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:49:40.587939    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc\": container with ID starting with 2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc not found: ID does not exist" containerID="2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc"
Jul 03 09:49:40.587997 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.587960    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc"} err="failed to get container status \"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc\": rpc error: code = NotFound desc = could not find container \"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc\": container with ID starting with 2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc not found: ID does not exist"
Jul 03 09:49:40.587997 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.587975    2580 scope.go:117] "RemoveContainer" containerID="2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3"
Jul 03 09:49:40.588195 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:49:40.588178    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3\": container with ID starting with 2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3 not found: ID does not exist" containerID="2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3"
Jul 03 09:49:40.588254 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.588204    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3"} err="failed to get container status \"2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3\": rpc error: code = NotFound desc = could not find container \"2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3\": container with ID starting with 2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3 not found: ID does not exist"
Jul 03 09:49:40.588254 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.588227    2580 scope.go:117] "RemoveContainer" containerID="291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2"
Jul 03 09:49:40.588463 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.588442    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2"} err="failed to get container status \"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2\": rpc error: code = NotFound desc = could not find container \"291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2\": container with ID starting with 291a976580f24226f832635a94766f6201366cb39720373e7f629976498818c2 not found: ID does not exist"
Jul 03 09:49:40.588503 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.588464    2580 scope.go:117] "RemoveContainer" containerID="ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55"
Jul 03 09:49:40.588666 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.588649    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55"} err="failed to get container status \"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55\": rpc error: code = NotFound desc = could not find container \"ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55\": container with ID starting with ba1cc8d39c261337361df852df9f410d14258a8479bf21372b73c418eabf1d55 not found: ID does not exist"
Jul 03 09:49:40.588711 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.588666    2580 scope.go:117] "RemoveContainer" containerID="2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90"
Jul 03 09:49:40.588885 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.588867    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90"} err="failed to get container status \"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90\": rpc error: code = NotFound desc = could not find container \"2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90\": container with ID starting with 2b9562bc212ce0cad087147409b4d3e20d8f9e869f0b9a91c66bd40d1d405b90 not found: ID does not exist"
Jul 03 09:49:40.588955 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.588887    2580 scope.go:117] "RemoveContainer" containerID="88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856"
Jul 03 09:49:40.589090 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.589073    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856"} err="failed to get container status \"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856\": rpc error: code = NotFound desc = could not find container \"88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856\": container with ID starting with 88c07766f97c914bd89b22105978e13410f1fb35126184a1fd5fedd69798e856 not found: ID does not exist"
Jul 03 09:49:40.589130 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.589092    2580 scope.go:117] "RemoveContainer" containerID="cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521"
Jul 03 09:49:40.589285 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.589267    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521"} err="failed to get container status \"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521\": rpc error: code = NotFound desc = could not find container \"cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521\": container with ID starting with cac70b9d5e68a3cb13eea0eb9fdf75f08565f47bd56b0b08e6765cec59aa8521 not found: ID does not exist"
Jul 03 09:49:40.589330 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.589286    2580 scope.go:117] "RemoveContainer" containerID="2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc"
Jul 03 09:49:40.589471 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.589452    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc"} err="failed to get container status \"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc\": rpc error: code = NotFound desc = could not find container \"2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc\": container with ID starting with 2245aec15cbfa76049b2a4e642f48f6dc30fe7fa14988c32ee9ad91d8a0548cc not found: ID does not exist"
Jul 03 09:49:40.589529 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.589472    2580 scope.go:117] "RemoveContainer" containerID="2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3"
Jul 03 09:49:40.589658 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.589643    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3"} err="failed to get container status \"2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3\": rpc error: code = NotFound desc = could not find container \"2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3\": container with ID starting with 2ac3d6282d0fd59fda8b5df043cf8ce3de3f2f31029dd80d5b36d019d1cacdd3 not found: ID does not exist"
Jul 03 09:49:40.599353 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599333    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:49:40.599556 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599545    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8274ca7d-200c-4e1d-af67-ed18b9c332be" containerName="registry"
Jul 03 09:49:40.599597 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599558    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8274ca7d-200c-4e1d-af67-ed18b9c332be" containerName="registry"
Jul 03 09:49:40.599597 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599570    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="init-config-reloader"
Jul 03 09:49:40.599597 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599575    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="init-config-reloader"
Jul 03 09:49:40.599597 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599584    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="alertmanager"
Jul 03 09:49:40.599597 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599589    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="alertmanager"
Jul 03 09:49:40.599597 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599596    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="config-reloader"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599603    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="config-reloader"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599612    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy-web"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599617    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy-web"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599624    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599629    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599634    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy-metric"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599638    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy-metric"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599643    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="prom-label-proxy"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599648    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="prom-label-proxy"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599686    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="config-reloader"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599693    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="prom-label-proxy"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599698    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8274ca7d-200c-4e1d-af67-ed18b9c332be" containerName="registry"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599702    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="alertmanager"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599707    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy-web"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599712    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy"
Jul 03 09:49:40.599787 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.599718    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" containerName="kube-rbac-proxy-metric"
Jul 03 09:49:40.602588 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.602574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.604861 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.604845    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 03 09:49:40.604971 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.604937    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 03 09:49:40.604971 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.604954    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 03 09:49:40.605105 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.605078    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dzzb5\""
Jul 03 09:49:40.605165 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.605143    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 03 09:49:40.605165 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.605163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 03 09:49:40.605274 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.605167    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 03 09:49:40.605274 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.605192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 03 09:49:40.605274 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.605235    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 03 09:49:40.615354 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.615335    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 03 09:49:40.619372 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.619355    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:49:40.667944 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.667917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668056 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.667959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668056 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.667986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-web-config\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668130 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668130 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668130 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-config-out\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668130 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzx57\" (UniqueName: \"kubernetes.io/projected/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-kube-api-access-lzx57\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-config-volume\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.668446 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.668286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.768798 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.768910 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-web-config\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.768910 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.768910 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.768910 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-config-out\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.768910 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzx57\" (UniqueName: \"kubernetes.io/projected/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-kube-api-access-lzx57\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769154 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769154 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769154 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.768986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769154 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.769007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769154 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.769029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-config-volume\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769154 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.769051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769154 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.769088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769483 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.769398    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.769717 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.769690    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.770254 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.770230    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.771850 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.771828    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.772115 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.772092    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-config-out\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.772364 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.772336    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.772468 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.772438    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.772468 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.772456    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.772637 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.772620    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.772792 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.772765    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.772869 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.772836    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-config-volume\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.773062 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.773046    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-web-config\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.776961 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.776944    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzx57\" (UniqueName: \"kubernetes.io/projected/34329fe6-5ee3-4b55-8cf3-a60e7299ce63-kube-api-access-lzx57\") pod \"alertmanager-main-0\" (UID: \"34329fe6-5ee3-4b55-8cf3-a60e7299ce63\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:40.912794 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:40.912690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 03 09:49:41.043115 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:41.043084    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 03 09:49:41.046146 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:49:41.046121    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34329fe6_5ee3_4b55_8cf3_a60e7299ce63.slice/crio-5e58b2d486b42e33f315d4ab6464a0a313d010cf230366e412cd37d22b015556 WatchSource:0}: Error finding container 5e58b2d486b42e33f315d4ab6464a0a313d010cf230366e412cd37d22b015556: Status 404 returned error can't find the container with id 5e58b2d486b42e33f315d4ab6464a0a313d010cf230366e412cd37d22b015556
Jul 03 09:49:41.545700 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:41.545664    2580 generic.go:356] "Generic (PLEG): container finished" podID="34329fe6-5ee3-4b55-8cf3-a60e7299ce63" containerID="ecaf237a1d95936d45a1e60b9c158d32bc1e4b99f1202c52634d4bc3396c9ed9" exitCode=0
Jul 03 09:49:41.546093 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:41.545724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34329fe6-5ee3-4b55-8cf3-a60e7299ce63","Type":"ContainerDied","Data":"ecaf237a1d95936d45a1e60b9c158d32bc1e4b99f1202c52634d4bc3396c9ed9"}
Jul 03 09:49:41.546093 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:41.545803    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34329fe6-5ee3-4b55-8cf3-a60e7299ce63","Type":"ContainerStarted","Data":"5e58b2d486b42e33f315d4ab6464a0a313d010cf230366e412cd37d22b015556"}
Jul 03 09:49:42.289897 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:42.289868    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3d7a825-cd2f-47f7-8035-4652282d1aba" path="/var/lib/kubelet/pods/b3d7a825-cd2f-47f7-8035-4652282d1aba/volumes"
Jul 03 09:49:42.553210 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:42.553136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34329fe6-5ee3-4b55-8cf3-a60e7299ce63","Type":"ContainerStarted","Data":"6dd1ec6557c08e5bd690d289dc06e84c9acada90f7501c18a0c4d65d1fc3b450"}
Jul 03 09:49:42.553210 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:42.553199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34329fe6-5ee3-4b55-8cf3-a60e7299ce63","Type":"ContainerStarted","Data":"b55aa93516d68ee4cf94c1d298e7c9f05257b860d7dd4ac4e03693026c8b1308"}
Jul 03 09:49:42.553565 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:42.553223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34329fe6-5ee3-4b55-8cf3-a60e7299ce63","Type":"ContainerStarted","Data":"e6239d4cb37dba3bcad4453b8a40d71fc37b5e6d18a6c4ba668c274eb75f4ffb"}
Jul 03 09:49:42.553565 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:42.553247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34329fe6-5ee3-4b55-8cf3-a60e7299ce63","Type":"ContainerStarted","Data":"2bc0643ecb8300017632fb845b7692f6fe66aeed6948ba39a045f51c62283dd4"}
Jul 03 09:49:42.553565 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:42.553270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34329fe6-5ee3-4b55-8cf3-a60e7299ce63","Type":"ContainerStarted","Data":"b5b478505dfdb1947742f5d212f66d918ae7aed93664fd21e5f1f648e6dc422f"}
Jul 03 09:49:42.553565 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:42.553292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34329fe6-5ee3-4b55-8cf3-a60e7299ce63","Type":"ContainerStarted","Data":"8f22c67ec51151f641c1a0653e25602bd74827cc1424ea65d6fb83f0ce15e032"}
Jul 03 09:49:42.583645 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:49:42.583590    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.56871802 podStartE2EDuration="2.583569471s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.851451ms" isStatefulPod=false podCreationTimestamp="2026-07-03 09:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:49:42.582523743 +0000 UTC m=+386.750999144" watchObservedRunningTime="2026-07-03 09:49:42.583569471 +0000 UTC m=+386.752044873"
Jul 03 09:50:04.225862 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:04.225822    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c76c79ff-hpnjc"]
Jul 03 09:50:29.246008 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.245937    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66c76c79ff-hpnjc" podUID="ff316bed-c9fd-4f05-a2b1-20efc8d03275" containerName="console" containerID="cri-o://b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9" gracePeriod=15
Jul 03 09:50:29.474269 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.474245    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:50:29.610227 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610197    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-serving-cert\") pod \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") "
Jul 03 09:50:29.610381 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610263    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-config\") pod \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") "
Jul 03 09:50:29.610381 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610285    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-service-ca\") pod \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") "
Jul 03 09:50:29.610381 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzf64\" (UniqueName: \"kubernetes.io/projected/ff316bed-c9fd-4f05-a2b1-20efc8d03275-kube-api-access-tzf64\") pod \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") "
Jul 03 09:50:29.610381 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-trusted-ca-bundle\") pod \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") "
Jul 03 09:50:29.610381 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-oauth-config\") pod \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") "
Jul 03 09:50:29.610381 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610365    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-oauth-serving-cert\") pod \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\" (UID: \"ff316bed-c9fd-4f05-a2b1-20efc8d03275\") "
Jul 03 09:50:29.610709 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610583    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-config" (OuterVolumeSpecName: "console-config") pod "ff316bed-c9fd-4f05-a2b1-20efc8d03275" (UID: "ff316bed-c9fd-4f05-a2b1-20efc8d03275"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:50:29.610866 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610842    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff316bed-c9fd-4f05-a2b1-20efc8d03275" (UID: "ff316bed-c9fd-4f05-a2b1-20efc8d03275"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:50:29.610866 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610861    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff316bed-c9fd-4f05-a2b1-20efc8d03275" (UID: "ff316bed-c9fd-4f05-a2b1-20efc8d03275"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:50:29.611013 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.610919    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff316bed-c9fd-4f05-a2b1-20efc8d03275" (UID: "ff316bed-c9fd-4f05-a2b1-20efc8d03275"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:50:29.612585 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.612553    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff316bed-c9fd-4f05-a2b1-20efc8d03275" (UID: "ff316bed-c9fd-4f05-a2b1-20efc8d03275"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:50:29.612681 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.612593    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff316bed-c9fd-4f05-a2b1-20efc8d03275" (UID: "ff316bed-c9fd-4f05-a2b1-20efc8d03275"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:50:29.612681 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.612601    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff316bed-c9fd-4f05-a2b1-20efc8d03275-kube-api-access-tzf64" (OuterVolumeSpecName: "kube-api-access-tzf64") pod "ff316bed-c9fd-4f05-a2b1-20efc8d03275" (UID: "ff316bed-c9fd-4f05-a2b1-20efc8d03275"). InnerVolumeSpecName "kube-api-access-tzf64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:50:29.710896 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.710866    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-serving-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:50:29.710896 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.710893    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-config\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:50:29.711053 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.710906    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-service-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:50:29.711053 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.710917    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzf64\" (UniqueName: \"kubernetes.io/projected/ff316bed-c9fd-4f05-a2b1-20efc8d03275-kube-api-access-tzf64\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:50:29.711053 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.710928    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-trusted-ca-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:50:29.711053 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.710939    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff316bed-c9fd-4f05-a2b1-20efc8d03275-console-oauth-config\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:50:29.711053 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.710951    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff316bed-c9fd-4f05-a2b1-20efc8d03275-oauth-serving-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:50:29.723447 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.723423    2580 generic.go:356] "Generic (PLEG): container finished" podID="ff316bed-c9fd-4f05-a2b1-20efc8d03275" containerID="b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9" exitCode=0
Jul 03 09:50:29.723556 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.723464    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c76c79ff-hpnjc" event={"ID":"ff316bed-c9fd-4f05-a2b1-20efc8d03275","Type":"ContainerDied","Data":"b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9"}
Jul 03 09:50:29.723556 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.723476    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66c76c79ff-hpnjc"
Jul 03 09:50:29.723556 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.723503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66c76c79ff-hpnjc" event={"ID":"ff316bed-c9fd-4f05-a2b1-20efc8d03275","Type":"ContainerDied","Data":"27cd912a8fd7164bccae879f29979340531297334c6d6dd7b82795b162129961"}
Jul 03 09:50:29.723556 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.723522    2580 scope.go:117] "RemoveContainer" containerID="b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9"
Jul 03 09:50:29.731960 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.731946    2580 scope.go:117] "RemoveContainer" containerID="b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9"
Jul 03 09:50:29.732235 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:50:29.732214    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9\": container with ID starting with b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9 not found: ID does not exist" containerID="b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9"
Jul 03 09:50:29.732318 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.732241    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9"} err="failed to get container status \"b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9\": rpc error: code = NotFound desc = could not find container \"b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9\": container with ID starting with b2ad2bee11943b6d5a3ff3df41338d1d7bafb7d5f972f5a19ccca4aeae9ddda9 not found: ID does not exist"
Jul 03 09:50:29.745917 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.745895    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66c76c79ff-hpnjc"]
Jul 03 09:50:29.750085 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:29.750064    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66c76c79ff-hpnjc"]
Jul 03 09:50:30.289004 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:50:30.288965    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff316bed-c9fd-4f05-a2b1-20efc8d03275" path="/var/lib/kubelet/pods/ff316bed-c9fd-4f05-a2b1-20efc8d03275/volumes"
Jul 03 09:51:02.031421 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.031388    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"]
Jul 03 09:51:02.031864 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.031651    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff316bed-c9fd-4f05-a2b1-20efc8d03275" containerName="console"
Jul 03 09:51:02.031864 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.031662    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff316bed-c9fd-4f05-a2b1-20efc8d03275" containerName="console"
Jul 03 09:51:02.031864 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.031704    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff316bed-c9fd-4f05-a2b1-20efc8d03275" containerName="console"
Jul 03 09:51:02.034752 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.034723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.039120 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.039099    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 03 09:51:02.039244 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.039183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xpkhh\""
Jul 03 09:51:02.039446 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.039421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 03 09:51:02.049452 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.049427    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"]
Jul 03 09:51:02.144657 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.144623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.144848 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.144670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.144848 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.144705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm6k9\" (UniqueName: \"kubernetes.io/projected/86df0703-0c2a-4765-bf60-922d90f88fbf-kube-api-access-zm6k9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.245510 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.245478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.245510 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.245525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.245794 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.245551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm6k9\" (UniqueName: \"kubernetes.io/projected/86df0703-0c2a-4765-bf60-922d90f88fbf-kube-api-access-zm6k9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.245953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.245933    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.245953 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.245946    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.255558 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.255541    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm6k9\" (UniqueName: \"kubernetes.io/projected/86df0703-0c2a-4765-bf60-922d90f88fbf-kube-api-access-zm6k9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.343439 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.343339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:02.467016 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.466987    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"]
Jul 03 09:51:02.833402 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:02.833365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk" event={"ID":"86df0703-0c2a-4765-bf60-922d90f88fbf","Type":"ContainerStarted","Data":"5b37388690b049ebf25ca82a3d09ba9dad74ad3b2567abb5e0d31aa5e4482451"}
Jul 03 09:51:09.861482 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:09.861451    2580 generic.go:356] "Generic (PLEG): container finished" podID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerID="882c0d58fc52cec344906c87d7fb8abb147eb86c176a2c2759666773b5b259f2" exitCode=0
Jul 03 09:51:09.861887 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:09.861509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk" event={"ID":"86df0703-0c2a-4765-bf60-922d90f88fbf","Type":"ContainerDied","Data":"882c0d58fc52cec344906c87d7fb8abb147eb86c176a2c2759666773b5b259f2"}
Jul 03 09:51:12.874474 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:12.874440    2580 generic.go:356] "Generic (PLEG): container finished" podID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerID="2ee78bad5933ffa1fe3f82e599b558d344caf813de181599677f3682ebabb0d1" exitCode=0
Jul 03 09:51:12.874881 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:12.874507    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk" event={"ID":"86df0703-0c2a-4765-bf60-922d90f88fbf","Type":"ContainerDied","Data":"2ee78bad5933ffa1fe3f82e599b558d344caf813de181599677f3682ebabb0d1"}
Jul 03 09:51:21.907450 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:21.907417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk" event={"ID":"86df0703-0c2a-4765-bf60-922d90f88fbf","Type":"ContainerStarted","Data":"fb8da16e8f38a6a2afb45b3e838636f11380f068dbe9e152e80663d0c5fe041d"}
Jul 03 09:51:21.926365 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:21.926324    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk" podStartSLOduration=2.431567823 podStartE2EDuration="19.926309251s" totalImagesPullingTime="17.494741428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:51:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:51:21.925416332 +0000 UTC m=+486.093891735" watchObservedRunningTime="2026-07-03 09:51:21.926309251 +0000 UTC m=+486.094784652"
Jul 03 09:51:22.913030 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:22.913000    2580 generic.go:356] "Generic (PLEG): container finished" podID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerID="fb8da16e8f38a6a2afb45b3e838636f11380f068dbe9e152e80663d0c5fe041d" exitCode=0
Jul 03 09:51:22.913391 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:22.913034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk" event={"ID":"86df0703-0c2a-4765-bf60-922d90f88fbf","Type":"ContainerDied","Data":"fb8da16e8f38a6a2afb45b3e838636f11380f068dbe9e152e80663d0c5fe041d"}
Jul 03 09:51:24.078620 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.078597    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:24.110774 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.110728    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm6k9\" (UniqueName: \"kubernetes.io/projected/86df0703-0c2a-4765-bf60-922d90f88fbf-kube-api-access-zm6k9\") pod \"86df0703-0c2a-4765-bf60-922d90f88fbf\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") "
Jul 03 09:51:24.110904 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.110809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-util\") pod \"86df0703-0c2a-4765-bf60-922d90f88fbf\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") "
Jul 03 09:51:24.110904 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.110851    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-bundle\") pod \"86df0703-0c2a-4765-bf60-922d90f88fbf\" (UID: \"86df0703-0c2a-4765-bf60-922d90f88fbf\") "
Jul 03 09:51:24.111462 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.111435    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-bundle" (OuterVolumeSpecName: "bundle") pod "86df0703-0c2a-4765-bf60-922d90f88fbf" (UID: "86df0703-0c2a-4765-bf60-922d90f88fbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:51:24.112854 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.112833    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86df0703-0c2a-4765-bf60-922d90f88fbf-kube-api-access-zm6k9" (OuterVolumeSpecName: "kube-api-access-zm6k9") pod "86df0703-0c2a-4765-bf60-922d90f88fbf" (UID: "86df0703-0c2a-4765-bf60-922d90f88fbf"). InnerVolumeSpecName "kube-api-access-zm6k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:51:24.114899 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.114877    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-util" (OuterVolumeSpecName: "util") pod "86df0703-0c2a-4765-bf60-922d90f88fbf" (UID: "86df0703-0c2a-4765-bf60-922d90f88fbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:51:24.211615 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.211553    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-util\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:51:24.211615 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.211577    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86df0703-0c2a-4765-bf60-922d90f88fbf-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:51:24.211615 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.211588    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm6k9\" (UniqueName: \"kubernetes.io/projected/86df0703-0c2a-4765-bf60-922d90f88fbf-kube-api-access-zm6k9\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:51:24.921948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.921912    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk" event={"ID":"86df0703-0c2a-4765-bf60-922d90f88fbf","Type":"ContainerDied","Data":"5b37388690b049ebf25ca82a3d09ba9dad74ad3b2567abb5e0d31aa5e4482451"}
Jul 03 09:51:24.921948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.921941    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zn9bk"
Jul 03 09:51:24.922142 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:24.921986    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b37388690b049ebf25ca82a3d09ba9dad74ad3b2567abb5e0d31aa5e4482451"
Jul 03 09:51:30.132286 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.132251    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"]
Jul 03 09:51:30.132653 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.132482    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerName="util"
Jul 03 09:51:30.132653 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.132492    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerName="util"
Jul 03 09:51:30.132653 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.132505    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerName="extract"
Jul 03 09:51:30.132653 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.132512    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerName="extract"
Jul 03 09:51:30.132653 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.132522    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerName="pull"
Jul 03 09:51:30.132653 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.132527    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerName="pull"
Jul 03 09:51:30.132653 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.132575    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86df0703-0c2a-4765-bf60-922d90f88fbf" containerName="extract"
Jul 03 09:51:30.134556 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.134541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"
Jul 03 09:51:30.136980 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.136955    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:51:30.139532 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.139509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v56gs\""
Jul 03 09:51:30.139654 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.139632    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 03 09:51:30.149791 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.149771    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"]
Jul 03 09:51:30.153557 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.153534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20e7d8db-862b-4b84-acc8-179812781d69-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fgm67\" (UID: \"20e7d8db-862b-4b84-acc8-179812781d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"
Jul 03 09:51:30.153649 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.153582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml844\" (UniqueName: \"kubernetes.io/projected/20e7d8db-862b-4b84-acc8-179812781d69-kube-api-access-ml844\") pod \"cert-manager-operator-controller-manager-55c444bf86-fgm67\" (UID: \"20e7d8db-862b-4b84-acc8-179812781d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"
Jul 03 09:51:30.254668 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.254637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20e7d8db-862b-4b84-acc8-179812781d69-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fgm67\" (UID: \"20e7d8db-862b-4b84-acc8-179812781d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"
Jul 03 09:51:30.254668 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.254673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml844\" (UniqueName: \"kubernetes.io/projected/20e7d8db-862b-4b84-acc8-179812781d69-kube-api-access-ml844\") pod \"cert-manager-operator-controller-manager-55c444bf86-fgm67\" (UID: \"20e7d8db-862b-4b84-acc8-179812781d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"
Jul 03 09:51:30.255006 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.254989    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20e7d8db-862b-4b84-acc8-179812781d69-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fgm67\" (UID: \"20e7d8db-862b-4b84-acc8-179812781d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"
Jul 03 09:51:30.262996 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.262970    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml844\" (UniqueName: \"kubernetes.io/projected/20e7d8db-862b-4b84-acc8-179812781d69-kube-api-access-ml844\") pod \"cert-manager-operator-controller-manager-55c444bf86-fgm67\" (UID: \"20e7d8db-862b-4b84-acc8-179812781d69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"
Jul 03 09:51:30.443286 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.443215    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"
Jul 03 09:51:30.572352 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.572330    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67"]
Jul 03 09:51:30.574486 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:51:30.574461    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e7d8db_862b_4b84_acc8_179812781d69.slice/crio-ab1e5eb13048fe71eca8e5577bfd98d8715e4dbd7b2bab37f7bffc76311ddc16 WatchSource:0}: Error finding container ab1e5eb13048fe71eca8e5577bfd98d8715e4dbd7b2bab37f7bffc76311ddc16: Status 404 returned error can't find the container with id ab1e5eb13048fe71eca8e5577bfd98d8715e4dbd7b2bab37f7bffc76311ddc16
Jul 03 09:51:30.943928 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:30.943895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67" event={"ID":"20e7d8db-862b-4b84-acc8-179812781d69","Type":"ContainerStarted","Data":"ab1e5eb13048fe71eca8e5577bfd98d8715e4dbd7b2bab37f7bffc76311ddc16"}
Jul 03 09:51:32.953968 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:32.953933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67" event={"ID":"20e7d8db-862b-4b84-acc8-179812781d69","Type":"ContainerStarted","Data":"cd2a8dc31ef31c955e02d14df885b162f955342b74f947a0d9aa8259ae30dd18"}
Jul 03 09:51:32.987908 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:32.987864    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fgm67" podStartSLOduration=1.303409834 podStartE2EDuration="2.987849353s" totalImagesPullingTime="1.684439519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:51:32.986102838 +0000 UTC m=+497.154578239" watchObservedRunningTime="2026-07-03 09:51:32.987849353 +0000 UTC m=+497.156324754"
Jul 03 09:51:34.037838 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.037808    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"]
Jul 03 09:51:34.040335 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.040319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.044572 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.044550    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 03 09:51:34.044825 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.044805    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 03 09:51:34.045583 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.045569    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xpkhh\""
Jul 03 09:51:34.059536 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.059510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"]
Jul 03 09:51:34.082592 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.082570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.082709 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.082601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.082709 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.082625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hwnd\" (UniqueName: \"kubernetes.io/projected/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-kube-api-access-4hwnd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.184003 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.183971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.184003 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.184005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.184191 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.184028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hwnd\" (UniqueName: \"kubernetes.io/projected/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-kube-api-access-4hwnd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.184413 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.184393    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.184453 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.184407    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.194360 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.194338    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hwnd\" (UniqueName: \"kubernetes.io/projected/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-kube-api-access-4hwnd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.349501 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.349438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:34.494761 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:51:34.494717    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94cb692_07ca_4231_b296_1a2f4cf9f8ea.slice/crio-5c8f3db0f43c4ba6482efa972b3977b145bc5e2b75c86d07c590999664c0c479 WatchSource:0}: Error finding container 5c8f3db0f43c4ba6482efa972b3977b145bc5e2b75c86d07c590999664c0c479: Status 404 returned error can't find the container with id 5c8f3db0f43c4ba6482efa972b3977b145bc5e2b75c86d07c590999664c0c479
Jul 03 09:51:34.494895 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.494873    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"]
Jul 03 09:51:34.966955 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.966919    2580 generic.go:356] "Generic (PLEG): container finished" podID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerID="98af79aefe8c48ff045d0a6ba1b359fb5c47a2f71c43c080d7dc4f3368b05352" exitCode=0
Jul 03 09:51:34.967109 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.966984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62" event={"ID":"d94cb692-07ca-4231-b296-1a2f4cf9f8ea","Type":"ContainerDied","Data":"98af79aefe8c48ff045d0a6ba1b359fb5c47a2f71c43c080d7dc4f3368b05352"}
Jul 03 09:51:34.967109 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:34.967023    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62" event={"ID":"d94cb692-07ca-4231-b296-1a2f4cf9f8ea","Type":"ContainerStarted","Data":"5c8f3db0f43c4ba6482efa972b3977b145bc5e2b75c86d07c590999664c0c479"}
Jul 03 09:51:35.043523 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.043495    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dtg5"]
Jul 03 09:51:35.045528 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.045512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:35.047687 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.047663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 03 09:51:35.047849 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.047833    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 03 09:51:35.047933 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.047919    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9ql2c\""
Jul 03 09:51:35.055049 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.055030    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dtg5"]
Jul 03 09:51:35.091278 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.091249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64lxw\" (UniqueName: \"kubernetes.io/projected/94ff55d6-40a3-4926-803c-d2869604ccf6-kube-api-access-64lxw\") pod \"cert-manager-webhook-6486ffd997-5dtg5\" (UID: \"94ff55d6-40a3-4926-803c-d2869604ccf6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:35.091398 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.091297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ff55d6-40a3-4926-803c-d2869604ccf6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dtg5\" (UID: \"94ff55d6-40a3-4926-803c-d2869604ccf6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:35.192314 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.192285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64lxw\" (UniqueName: \"kubernetes.io/projected/94ff55d6-40a3-4926-803c-d2869604ccf6-kube-api-access-64lxw\") pod \"cert-manager-webhook-6486ffd997-5dtg5\" (UID: \"94ff55d6-40a3-4926-803c-d2869604ccf6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:35.192473 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.192329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ff55d6-40a3-4926-803c-d2869604ccf6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dtg5\" (UID: \"94ff55d6-40a3-4926-803c-d2869604ccf6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:35.200206 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.200177    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ff55d6-40a3-4926-803c-d2869604ccf6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dtg5\" (UID: \"94ff55d6-40a3-4926-803c-d2869604ccf6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:35.200284 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.200276    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64lxw\" (UniqueName: \"kubernetes.io/projected/94ff55d6-40a3-4926-803c-d2869604ccf6-kube-api-access-64lxw\") pod \"cert-manager-webhook-6486ffd997-5dtg5\" (UID: \"94ff55d6-40a3-4926-803c-d2869604ccf6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:35.353981 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.353947    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:35.480956 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.480914    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dtg5"]
Jul 03 09:51:35.485044 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:51:35.485016    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ff55d6_40a3_4926_803c_d2869604ccf6.slice/crio-4e3e284de574021f1abb9a79883780b15dd6d7cebf2adb7842fafd44ed910962 WatchSource:0}: Error finding container 4e3e284de574021f1abb9a79883780b15dd6d7cebf2adb7842fafd44ed910962: Status 404 returned error can't find the container with id 4e3e284de574021f1abb9a79883780b15dd6d7cebf2adb7842fafd44ed910962
Jul 03 09:51:35.974198 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:35.974157    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5" event={"ID":"94ff55d6-40a3-4926-803c-d2869604ccf6","Type":"ContainerStarted","Data":"4e3e284de574021f1abb9a79883780b15dd6d7cebf2adb7842fafd44ed910962"}
Jul 03 09:51:37.985035 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:37.985000    2580 generic.go:356] "Generic (PLEG): container finished" podID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerID="69936e00d3c2cbf098bfe43f864fe6d62ebc2be1af29235445d7cb22613dc661" exitCode=0
Jul 03 09:51:37.985547 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:37.985084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62" event={"ID":"d94cb692-07ca-4231-b296-1a2f4cf9f8ea","Type":"ContainerDied","Data":"69936e00d3c2cbf098bfe43f864fe6d62ebc2be1af29235445d7cb22613dc661"}
Jul 03 09:51:38.991398 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:38.991359    2580 generic.go:356] "Generic (PLEG): container finished" podID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerID="36029118ff6a816e995da70d7aa53c0b35bc62467f543c937d6bb971cde00ea7" exitCode=0
Jul 03 09:51:38.991800 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:38.991448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62" event={"ID":"d94cb692-07ca-4231-b296-1a2f4cf9f8ea","Type":"ContainerDied","Data":"36029118ff6a816e995da70d7aa53c0b35bc62467f543c937d6bb971cde00ea7"}
Jul 03 09:51:39.996823 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:39.996788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5" event={"ID":"94ff55d6-40a3-4926-803c-d2869604ccf6","Type":"ContainerStarted","Data":"cd8520d804c840fc749e60da0868e335726f5630e48a7ecd9d370ac0d3ebbafc"}
Jul 03 09:51:40.017010 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.016961    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5" podStartSLOduration=1.27092597 podStartE2EDuration="5.016936506s" totalImagesPullingTime="3.746010536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:51:40.015282683 +0000 UTC m=+504.183758084" watchObservedRunningTime="2026-07-03 09:51:40.016936506 +0000 UTC m=+504.185411907"
Jul 03 09:51:40.120285 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.120260    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:40.232354 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.232324    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hwnd\" (UniqueName: \"kubernetes.io/projected/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-kube-api-access-4hwnd\") pod \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") "
Jul 03 09:51:40.232500 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.232394    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-bundle\") pod \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") "
Jul 03 09:51:40.232500 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.232423    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-util\") pod \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\" (UID: \"d94cb692-07ca-4231-b296-1a2f4cf9f8ea\") "
Jul 03 09:51:40.232842 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.232809    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-bundle" (OuterVolumeSpecName: "bundle") pod "d94cb692-07ca-4231-b296-1a2f4cf9f8ea" (UID: "d94cb692-07ca-4231-b296-1a2f4cf9f8ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:51:40.234347 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.234321    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-kube-api-access-4hwnd" (OuterVolumeSpecName: "kube-api-access-4hwnd") pod "d94cb692-07ca-4231-b296-1a2f4cf9f8ea" (UID: "d94cb692-07ca-4231-b296-1a2f4cf9f8ea"). InnerVolumeSpecName "kube-api-access-4hwnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:51:40.236273 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.236243    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-util" (OuterVolumeSpecName: "util") pod "d94cb692-07ca-4231-b296-1a2f4cf9f8ea" (UID: "d94cb692-07ca-4231-b296-1a2f4cf9f8ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:51:40.333805 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.333784    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:51:40.333805 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.333804    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-util\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:51:40.333945 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:40.333813    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hwnd\" (UniqueName: \"kubernetes.io/projected/d94cb692-07ca-4231-b296-1a2f4cf9f8ea-kube-api-access-4hwnd\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:51:41.002907 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:41.002879    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62"
Jul 03 09:51:41.003286 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:41.002911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fpll62" event={"ID":"d94cb692-07ca-4231-b296-1a2f4cf9f8ea","Type":"ContainerDied","Data":"5c8f3db0f43c4ba6482efa972b3977b145bc5e2b75c86d07c590999664c0c479"}
Jul 03 09:51:41.003286 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:41.002980    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c8f3db0f43c4ba6482efa972b3977b145bc5e2b75c86d07c590999664c0c479"
Jul 03 09:51:41.003286 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:41.003130    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:46.756647 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.756614    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"]
Jul 03 09:51:46.757031 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.756875    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerName="extract"
Jul 03 09:51:46.757031 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.756886    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerName="extract"
Jul 03 09:51:46.757031 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.756905    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerName="pull"
Jul 03 09:51:46.757031 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.756912    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerName="pull"
Jul 03 09:51:46.757031 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.756919    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerName="util"
Jul 03 09:51:46.757031 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.756924    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerName="util"
Jul 03 09:51:46.757031 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.756962    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d94cb692-07ca-4231-b296-1a2f4cf9f8ea" containerName="extract"
Jul 03 09:51:46.760580 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.760565    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"
Jul 03 09:51:46.763058 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.763033    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 03 09:51:46.763179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.763094    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:51:46.763949 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.763934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4vl8s\""
Jul 03 09:51:46.767796 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.767776    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"]
Jul 03 09:51:46.882432 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.882395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3eba850-ba9b-4e51-80e8-04180e8fff9f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4hzft\" (UID: \"b3eba850-ba9b-4e51-80e8-04180e8fff9f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"
Jul 03 09:51:46.882604 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.882454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7655t\" (UniqueName: \"kubernetes.io/projected/b3eba850-ba9b-4e51-80e8-04180e8fff9f-kube-api-access-7655t\") pod \"openshift-lws-operator-fd8ccff4c-4hzft\" (UID: \"b3eba850-ba9b-4e51-80e8-04180e8fff9f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"
Jul 03 09:51:46.983714 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.983683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7655t\" (UniqueName: \"kubernetes.io/projected/b3eba850-ba9b-4e51-80e8-04180e8fff9f-kube-api-access-7655t\") pod \"openshift-lws-operator-fd8ccff4c-4hzft\" (UID: \"b3eba850-ba9b-4e51-80e8-04180e8fff9f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"
Jul 03 09:51:46.983876 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.983766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3eba850-ba9b-4e51-80e8-04180e8fff9f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4hzft\" (UID: \"b3eba850-ba9b-4e51-80e8-04180e8fff9f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"
Jul 03 09:51:46.984085 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.984066    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3eba850-ba9b-4e51-80e8-04180e8fff9f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4hzft\" (UID: \"b3eba850-ba9b-4e51-80e8-04180e8fff9f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"
Jul 03 09:51:46.992803 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:46.992778    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7655t\" (UniqueName: \"kubernetes.io/projected/b3eba850-ba9b-4e51-80e8-04180e8fff9f-kube-api-access-7655t\") pod \"openshift-lws-operator-fd8ccff4c-4hzft\" (UID: \"b3eba850-ba9b-4e51-80e8-04180e8fff9f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"
Jul 03 09:51:47.009086 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:47.009068    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5dtg5"
Jul 03 09:51:47.070195 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:47.070166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"
Jul 03 09:51:47.211804 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:47.211766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft"]
Jul 03 09:51:47.219778 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:51:47.219754    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3eba850_ba9b_4e51_80e8_04180e8fff9f.slice/crio-dc8c4ef6ca872ec1ef1a597ac635f6ea4116115362230686ac3b6b6f1d860ef0 WatchSource:0}: Error finding container dc8c4ef6ca872ec1ef1a597ac635f6ea4116115362230686ac3b6b6f1d860ef0: Status 404 returned error can't find the container with id dc8c4ef6ca872ec1ef1a597ac635f6ea4116115362230686ac3b6b6f1d860ef0
Jul 03 09:51:48.030780 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:48.030713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft" event={"ID":"b3eba850-ba9b-4e51-80e8-04180e8fff9f","Type":"ContainerStarted","Data":"dc8c4ef6ca872ec1ef1a597ac635f6ea4116115362230686ac3b6b6f1d860ef0"}
Jul 03 09:51:50.040646 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:50.040613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft" event={"ID":"b3eba850-ba9b-4e51-80e8-04180e8fff9f","Type":"ContainerStarted","Data":"b2e75a2c85a9dd917ffdd94261e2b31618a2cdda31880bebdb4749240eac03c9"}
Jul 03 09:51:50.058765 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:50.058699    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4hzft" podStartSLOduration=1.820611221 podStartE2EDuration="4.058684478s" totalImagesPullingTime="2.238073257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:51:50.058165568 +0000 UTC m=+514.226640969" watchObservedRunningTime="2026-07-03 09:51:50.058684478 +0000 UTC m=+514.227159879"
Jul 03 09:51:54.622533 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.622496    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"]
Jul 03 09:51:54.624874 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.624858    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.627133 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.627104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 03 09:51:54.627244 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.627166    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 03 09:51:54.628041 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.628022    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xpkhh\""
Jul 03 09:51:54.634067 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.634042    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"]
Jul 03 09:51:54.745029 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.744991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.745199 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.745056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.745199 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.745089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvqzl\" (UniqueName: \"kubernetes.io/projected/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-kube-api-access-rvqzl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.846139 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.846111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.846299 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.846142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvqzl\" (UniqueName: \"kubernetes.io/projected/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-kube-api-access-rvqzl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.846299 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.846177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.846543 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.846521    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.846607 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.846556    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.854595 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.854572    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvqzl\" (UniqueName: \"kubernetes.io/projected/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-kube-api-access-rvqzl\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:54.934429 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:54.934343    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:55.056223 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:55.056196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"]
Jul 03 09:51:55.058544 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:51:55.058518    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c06fb2_3aa3_48c5_b6e0_6810fd0147ef.slice/crio-e0a9035a2f19bb8bfb6d3576d687d38d2fb2e9d98038535f1d504d941f4764a7 WatchSource:0}: Error finding container e0a9035a2f19bb8bfb6d3576d687d38d2fb2e9d98038535f1d504d941f4764a7: Status 404 returned error can't find the container with id e0a9035a2f19bb8bfb6d3576d687d38d2fb2e9d98038535f1d504d941f4764a7
Jul 03 09:51:56.065924 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:56.065891    2580 generic.go:356] "Generic (PLEG): container finished" podID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerID="7e4da2540b18c35c97e85cd079af9f9bd96ceb7c53dd257251249dded5fd75d1" exitCode=0
Jul 03 09:51:56.066280 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:56.065963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf" event={"ID":"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef","Type":"ContainerDied","Data":"7e4da2540b18c35c97e85cd079af9f9bd96ceb7c53dd257251249dded5fd75d1"}
Jul 03 09:51:56.066280 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:56.066013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf" event={"ID":"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef","Type":"ContainerStarted","Data":"e0a9035a2f19bb8bfb6d3576d687d38d2fb2e9d98038535f1d504d941f4764a7"}
Jul 03 09:51:57.071164 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:57.071134    2580 generic.go:356] "Generic (PLEG): container finished" podID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerID="4529363baaac97993bf2b5fe6d6de5e6b66947dd6f1f4d9563a29c87f430dbbc" exitCode=0
Jul 03 09:51:57.071627 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:57.071184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf" event={"ID":"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef","Type":"ContainerDied","Data":"4529363baaac97993bf2b5fe6d6de5e6b66947dd6f1f4d9563a29c87f430dbbc"}
Jul 03 09:51:58.077444 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:58.077405    2580 generic.go:356] "Generic (PLEG): container finished" podID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerID="3878fe4ec1ac6a3bebbc6d2863f4ba229fedd3d9c677affc1b1b8c4846c0fb45" exitCode=0
Jul 03 09:51:58.077799 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:58.077493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf" event={"ID":"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef","Type":"ContainerDied","Data":"3878fe4ec1ac6a3bebbc6d2863f4ba229fedd3d9c677affc1b1b8c4846c0fb45"}
Jul 03 09:51:59.207906 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.207879    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:51:59.280836 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.280804    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-bundle\") pod \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") "
Jul 03 09:51:59.281007 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.280861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-util\") pod \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") "
Jul 03 09:51:59.281007 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.280884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvqzl\" (UniqueName: \"kubernetes.io/projected/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-kube-api-access-rvqzl\") pod \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\" (UID: \"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef\") "
Jul 03 09:51:59.281591 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.281566    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-bundle" (OuterVolumeSpecName: "bundle") pod "60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" (UID: "60c06fb2-3aa3-48c5-b6e0-6810fd0147ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:51:59.282995 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.282973    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-kube-api-access-rvqzl" (OuterVolumeSpecName: "kube-api-access-rvqzl") pod "60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" (UID: "60c06fb2-3aa3-48c5-b6e0-6810fd0147ef"). InnerVolumeSpecName "kube-api-access-rvqzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:51:59.286421 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.286381    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-util" (OuterVolumeSpecName: "util") pod "60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" (UID: "60c06fb2-3aa3-48c5-b6e0-6810fd0147ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:51:59.381711 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.381638    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:51:59.381711 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.381664    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-util\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:51:59.381711 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:51:59.381672    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvqzl\" (UniqueName: \"kubernetes.io/projected/60c06fb2-3aa3-48c5-b6e0-6810fd0147ef-kube-api-access-rvqzl\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:52:00.087070 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:00.087046    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf"
Jul 03 09:52:00.087230 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:00.087046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgtqgf" event={"ID":"60c06fb2-3aa3-48c5-b6e0-6810fd0147ef","Type":"ContainerDied","Data":"e0a9035a2f19bb8bfb6d3576d687d38d2fb2e9d98038535f1d504d941f4764a7"}
Jul 03 09:52:00.087230 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:00.087161    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0a9035a2f19bb8bfb6d3576d687d38d2fb2e9d98038535f1d504d941f4764a7"
Jul 03 09:52:06.612537 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.612502    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"]
Jul 03 09:52:06.612948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.612774    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerName="extract"
Jul 03 09:52:06.612948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.612787    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerName="extract"
Jul 03 09:52:06.612948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.612801    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerName="util"
Jul 03 09:52:06.612948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.612807    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerName="util"
Jul 03 09:52:06.612948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.612821    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerName="pull"
Jul 03 09:52:06.612948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.612826    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerName="pull"
Jul 03 09:52:06.612948 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.612888    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c06fb2-3aa3-48c5-b6e0-6810fd0147ef" containerName="extract"
Jul 03 09:52:06.615035 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.615021    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.618344 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.618320    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 03 09:52:06.619395 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.619377    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 03 09:52:06.619507 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.619393    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zswg2\""
Jul 03 09:52:06.619507 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.619477    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 03 09:52:06.619618 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.619516    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 03 09:52:06.651917 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.651891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"]
Jul 03 09:52:06.735094 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.735060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db25c703-90b1-4b62-b5e6-266bec99b347-manifests\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.735263 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.735103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db25c703-90b1-4b62-b5e6-266bec99b347-tmp\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.735263 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.735131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db25c703-90b1-4b62-b5e6-266bec99b347-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.735263 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.735185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db25c703-90b1-4b62-b5e6-266bec99b347-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.735263 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.735212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddrb\" (UniqueName: \"kubernetes.io/projected/db25c703-90b1-4b62-b5e6-266bec99b347-kube-api-access-wddrb\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.835910 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.835870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db25c703-90b1-4b62-b5e6-266bec99b347-tmp\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.835910 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.835913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db25c703-90b1-4b62-b5e6-266bec99b347-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.836192 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.835944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db25c703-90b1-4b62-b5e6-266bec99b347-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.836192 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.835962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wddrb\" (UniqueName: \"kubernetes.io/projected/db25c703-90b1-4b62-b5e6-266bec99b347-kube-api-access-wddrb\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.836192 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.836005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db25c703-90b1-4b62-b5e6-266bec99b347-manifests\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.836408 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.836388    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db25c703-90b1-4b62-b5e6-266bec99b347-manifests\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.838269 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.838244    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db25c703-90b1-4b62-b5e6-266bec99b347-tmp\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.838375 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.838317    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db25c703-90b1-4b62-b5e6-266bec99b347-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.838492 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.838477    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db25c703-90b1-4b62-b5e6-266bec99b347-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.845070 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.845046    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddrb\" (UniqueName: \"kubernetes.io/projected/db25c703-90b1-4b62-b5e6-266bec99b347-kube-api-access-wddrb\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-zc4md\" (UID: \"db25c703-90b1-4b62-b5e6-266bec99b347\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:06.925227 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:06.925141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:07.055797 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:07.055755    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"]
Jul 03 09:52:07.059580 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:52:07.059554    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb25c703_90b1_4b62_b5e6_266bec99b347.slice/crio-f906790adc1cd42e74b2738f4170ff1c7e32851f35ba51db56efcca887cbe3ae WatchSource:0}: Error finding container f906790adc1cd42e74b2738f4170ff1c7e32851f35ba51db56efcca887cbe3ae: Status 404 returned error can't find the container with id f906790adc1cd42e74b2738f4170ff1c7e32851f35ba51db56efcca887cbe3ae
Jul 03 09:52:07.118267 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:07.118234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md" event={"ID":"db25c703-90b1-4b62-b5e6-266bec99b347","Type":"ContainerStarted","Data":"f906790adc1cd42e74b2738f4170ff1c7e32851f35ba51db56efcca887cbe3ae"}
Jul 03 09:52:10.133199 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:10.133117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md" event={"ID":"db25c703-90b1-4b62-b5e6-266bec99b347","Type":"ContainerStarted","Data":"52512c754c4e729a31bb877b6df65e3fe11df95c216cb409f7ec2e6d0a9c73e4"}
Jul 03 09:52:11.138892 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:11.138860    2580 generic.go:356] "Generic (PLEG): container finished" podID="db25c703-90b1-4b62-b5e6-266bec99b347" containerID="52512c754c4e729a31bb877b6df65e3fe11df95c216cb409f7ec2e6d0a9c73e4" exitCode=0
Jul 03 09:52:11.139264 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:11.138927    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md" event={"ID":"db25c703-90b1-4b62-b5e6-266bec99b347","Type":"ContainerDied","Data":"52512c754c4e729a31bb877b6df65e3fe11df95c216cb409f7ec2e6d0a9c73e4"}
Jul 03 09:52:12.145463 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:12.145423    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md" event={"ID":"db25c703-90b1-4b62-b5e6-266bec99b347","Type":"ContainerStarted","Data":"def1bf25a8277a9fefd4842b3221b4c369b938011e987d15ee2c9432d3912c49"}
Jul 03 09:52:12.145895 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:12.145667    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:12.170893 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:12.170843    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md" podStartSLOduration=1.993981245 podStartE2EDuration="6.170827651s" totalImagesPullingTime="3.101266884s" totalInitContainerRuntime="1.075579522s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:52:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:52:12.168476815 +0000 UTC m=+536.336952226" watchObservedRunningTime="2026-07-03 09:52:12.170827651 +0000 UTC m=+536.339303052"
Jul 03 09:52:23.151537 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:23.151508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-zc4md"
Jul 03 09:52:25.074594 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.074557    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"]
Jul 03 09:52:25.187347 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.187316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"]
Jul 03 09:52:25.187496 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.187407    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.190863 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.190841    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 03 09:52:25.190988 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.190839    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wgc44\""
Jul 03 09:52:25.190988 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.190840    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 03 09:52:25.190988 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.190840    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 03 09:52:25.380394 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.380321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d787fdf6-eef3-4b67-88dc-331c8541a8cd-cert\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.380394 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.380361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d787fdf6-eef3-4b67-88dc-331c8541a8cd-metrics-cert\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.380598 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.380437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7jl\" (UniqueName: \"kubernetes.io/projected/d787fdf6-eef3-4b67-88dc-331c8541a8cd-kube-api-access-8l7jl\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.380598 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.380504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d787fdf6-eef3-4b67-88dc-331c8541a8cd-manager-config\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.481128 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.481094    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d787fdf6-eef3-4b67-88dc-331c8541a8cd-metrics-cert\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.481308 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.481144    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7jl\" (UniqueName: \"kubernetes.io/projected/d787fdf6-eef3-4b67-88dc-331c8541a8cd-kube-api-access-8l7jl\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.481308 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.481169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d787fdf6-eef3-4b67-88dc-331c8541a8cd-manager-config\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.481308 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.481222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d787fdf6-eef3-4b67-88dc-331c8541a8cd-cert\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.481890 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.481863    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d787fdf6-eef3-4b67-88dc-331c8541a8cd-manager-config\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.483655 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.483628    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d787fdf6-eef3-4b67-88dc-331c8541a8cd-metrics-cert\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.483655 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.483651    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d787fdf6-eef3-4b67-88dc-331c8541a8cd-cert\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.500961 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.500937    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7jl\" (UniqueName: \"kubernetes.io/projected/d787fdf6-eef3-4b67-88dc-331c8541a8cd-kube-api-access-8l7jl\") pod \"lws-controller-manager-75576cf7dd-6m9mb\" (UID: \"d787fdf6-eef3-4b67-88dc-331c8541a8cd\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.796814 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.796780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:25.948231 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:25.948193    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"]
Jul 03 09:52:25.957502 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:52:25.957469    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd787fdf6_eef3_4b67_88dc_331c8541a8cd.slice/crio-2c963a6cbf7b1bbaa8e61bfab5186cdc729e7e28edafc11df9a0cbd23d4f4d6e WatchSource:0}: Error finding container 2c963a6cbf7b1bbaa8e61bfab5186cdc729e7e28edafc11df9a0cbd23d4f4d6e: Status 404 returned error can't find the container with id 2c963a6cbf7b1bbaa8e61bfab5186cdc729e7e28edafc11df9a0cbd23d4f4d6e
Jul 03 09:52:26.205755 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:26.205656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb" event={"ID":"d787fdf6-eef3-4b67-88dc-331c8541a8cd","Type":"ContainerStarted","Data":"2c963a6cbf7b1bbaa8e61bfab5186cdc729e7e28edafc11df9a0cbd23d4f4d6e"}
Jul 03 09:52:28.218884 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:28.218849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb" event={"ID":"d787fdf6-eef3-4b67-88dc-331c8541a8cd","Type":"ContainerStarted","Data":"2f28c96f7f34f8859ee5a60c7a3feeb60c5317b49a766e75bc49b505aba03808"}
Jul 03 09:52:28.219265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:28.218909    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:28.237660 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:28.237604    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb" podStartSLOduration=1.5371822179999999 podStartE2EDuration="3.237581701s" totalImagesPullingTime="1.700399483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:52:28.23697598 +0000 UTC m=+552.405451386" watchObservedRunningTime="2026-07-03 09:52:28.237581701 +0000 UTC m=+552.406057104"
Jul 03 09:52:33.726644 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.726609    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"]
Jul 03 09:52:33.730392 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.730377    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.733258 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.733228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 03 09:52:33.733945 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.733925    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 03 09:52:33.734030 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.734015    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s7ppk\""
Jul 03 09:52:33.734395 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.734379    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 03 09:52:33.747979 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.747958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m994p\" (UniqueName: \"kubernetes.io/projected/2d84fba9-755b-4957-951f-b9630727633f-kube-api-access-m994p\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.748075 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.747990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d84fba9-755b-4957-951f-b9630727633f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.748075 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.748012    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d84fba9-755b-4957-951f-b9630727633f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.748075 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.748031    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d84fba9-755b-4957-951f-b9630727633f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.748179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.748081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.748179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.748112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.748179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.748133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.748179 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.748174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.748299 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.748197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.766143 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.766123    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"]
Jul 03 09:52:33.849341 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849341 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849587 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849587 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849587 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849587 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m994p\" (UniqueName: \"kubernetes.io/projected/2d84fba9-755b-4957-951f-b9630727633f-kube-api-access-m994p\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849830 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d84fba9-755b-4957-951f-b9630727633f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849830 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d84fba9-755b-4957-951f-b9630727633f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849830 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d84fba9-755b-4957-951f-b9630727633f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849969 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849827    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849969 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849918    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.849969 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.849949    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.850155 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.850135    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.850574 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.850550    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d84fba9-755b-4957-951f-b9630727633f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.852192 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.852168    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d84fba9-755b-4957-951f-b9630727633f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.852291 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.852214    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d84fba9-755b-4957-951f-b9630727633f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.872185 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.872161    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d84fba9-755b-4957-951f-b9630727633f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:33.873619 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:33.873599    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m994p\" (UniqueName: \"kubernetes.io/projected/2d84fba9-755b-4957-951f-b9630727633f-kube-api-access-m994p\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678zm9hx\" (UID: \"2d84fba9-755b-4957-951f-b9630727633f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:34.040409 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:34.040383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:34.222594 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:52:34.222565    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d84fba9_755b_4957_951f_b9630727633f.slice/crio-c58bb9347b9a7af1b91bb4106e5e5cd8c061d6a02cf75ed43d68a5d85125e5b5 WatchSource:0}: Error finding container c58bb9347b9a7af1b91bb4106e5e5cd8c061d6a02cf75ed43d68a5d85125e5b5: Status 404 returned error can't find the container with id c58bb9347b9a7af1b91bb4106e5e5cd8c061d6a02cf75ed43d68a5d85125e5b5
Jul 03 09:52:34.245008 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:34.244972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx" event={"ID":"2d84fba9-755b-4957-951f-b9630727633f","Type":"ContainerStarted","Data":"c58bb9347b9a7af1b91bb4106e5e5cd8c061d6a02cf75ed43d68a5d85125e5b5"}
Jul 03 09:52:34.246429 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:34.246391    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"]
Jul 03 09:52:35.884280 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.884245    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"]
Jul 03 09:52:35.891004 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.890980    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:35.893252 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.893222    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 03 09:52:35.893559 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.893544    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c92nq\""
Jul 03 09:52:35.893653 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.893543    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 03 09:52:35.894034 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.894018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 03 09:52:35.921754 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.921707    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"]
Jul 03 09:52:35.968852 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.968816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:35.969036 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.968879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:35.969036 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.968931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:35.969036 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.968956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c77c2aa-4569-44ed-9916-3d738740089a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:35.969036 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.968973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxjbx\" (UniqueName: \"kubernetes.io/projected/9c77c2aa-4569-44ed-9916-3d738740089a-kube-api-access-xxjbx\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:35.969036 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.969009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c77c2aa-4569-44ed-9916-3d738740089a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:35.969036 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:35.969034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c77c2aa-4569-44ed-9916-3d738740089a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.070054 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.070015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c77c2aa-4569-44ed-9916-3d738740089a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.070054 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.070063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c77c2aa-4569-44ed-9916-3d738740089a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.070287 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.070105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.070287 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.070135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.070287 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.070207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.070287 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.070236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c77c2aa-4569-44ed-9916-3d738740089a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.070287 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.070260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxjbx\" (UniqueName: \"kubernetes.io/projected/9c77c2aa-4569-44ed-9916-3d738740089a-kube-api-access-xxjbx\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.071229 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.071198    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9c77c2aa-4569-44ed-9916-3d738740089a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.073684 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.073636    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.073888 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.073863    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.074937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.074887    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9c77c2aa-4569-44ed-9916-3d738740089a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.075088 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.075051    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c77c2aa-4569-44ed-9916-3d738740089a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.083584 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.083546    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxjbx\" (UniqueName: \"kubernetes.io/projected/9c77c2aa-4569-44ed-9916-3d738740089a-kube-api-access-xxjbx\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.085243 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.085219    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c77c2aa-4569-44ed-9916-3d738740089a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lx62t\" (UID: \"9c77c2aa-4569-44ed-9916-3d738740089a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.202513 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.202428    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:36.651310 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.651266    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 09:52:36.651402 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.651357    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 09:52:36.651441 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.651399    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 09:52:36.731760 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:36.731719    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"]
Jul 03 09:52:36.733545 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:52:36.733521    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c77c2aa_4569_44ed_9916_3d738740089a.slice/crio-1bfcd67191bc06cab5828a7626974cb32242c9bc812535b3ba6782168bcf14da WatchSource:0}: Error finding container 1bfcd67191bc06cab5828a7626974cb32242c9bc812535b3ba6782168bcf14da: Status 404 returned error can't find the container with id 1bfcd67191bc06cab5828a7626974cb32242c9bc812535b3ba6782168bcf14da
Jul 03 09:52:37.260709 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:37.260670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t" event={"ID":"9c77c2aa-4569-44ed-9916-3d738740089a","Type":"ContainerStarted","Data":"1bfcd67191bc06cab5828a7626974cb32242c9bc812535b3ba6782168bcf14da"}
Jul 03 09:52:37.262103 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:37.262073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx" event={"ID":"2d84fba9-755b-4957-951f-b9630727633f","Type":"ContainerStarted","Data":"ff3f69052cc228152204d602ebc50b33223b844bef8ef0375a37ca542a15361f"}
Jul 03 09:52:37.338065 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:37.338012    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx" podStartSLOduration=1.911572483 podStartE2EDuration="4.337997116s" totalImagesPullingTime="2.426424633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:52:37.334930942 +0000 UTC m=+561.503406343" watchObservedRunningTime="2026-07-03 09:52:37.337997116 +0000 UTC m=+561.506472516"
Jul 03 09:52:38.041549 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:38.041507    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:38.042603 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:38.042579    2580 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body=
Jul 03 09:52:38.042673 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:38.042631    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx" podUID="2d84fba9-755b-4957-951f-b9630727633f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused"
Jul 03 09:52:39.044813 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:39.044787    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:39.225281 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:39.225251    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-6m9mb"
Jul 03 09:52:39.271315 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:39.271290    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:39.272343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:39.272322    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678zm9hx"
Jul 03 09:52:52.327578 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:52.327545    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 09:52:52.327839 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:52.327611    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 09:52:53.332224 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:53.332189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t" event={"ID":"9c77c2aa-4569-44ed-9916-3d738740089a","Type":"ContainerStarted","Data":"3855bb98e382248e119884c16d869077f64f77322e40d1b135e5282975bb24a1"}
Jul 03 09:52:53.332669 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:53.332334    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:52:53.333963 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:53.333937    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-lx62t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 03 09:52:53.334080 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:53.333981    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t" podUID="9c77c2aa-4569-44ed-9916-3d738740089a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 03 09:52:53.355936 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:53.355889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t" podStartSLOduration=2.764482814 podStartE2EDuration="18.355874965s" totalImagesPullingTime="15.591392151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:52:53.354035461 +0000 UTC m=+577.522510872" watchObservedRunningTime="2026-07-03 09:52:53.355874965 +0000 UTC m=+577.524350367"
Jul 03 09:52:54.336463 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:52:54.336429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lx62t"
Jul 03 09:53:42.914458 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:42.914373    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"]
Jul 03 09:53:42.917683 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:42.917667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:42.920343 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:42.920323    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 03 09:53:42.921024 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:42.921004    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 03 09:53:42.921024 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:42.921018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-phr6p\""
Jul 03 09:53:42.930675 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:42.930656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"]
Jul 03 09:53:43.011426 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.011398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.011565 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.011432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.011565 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.011512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr5sv\" (UniqueName: \"kubernetes.io/projected/f096526c-ab65-40d3-b60c-577312100182-kube-api-access-hr5sv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.112910 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.112871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.113069 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.113022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr5sv\" (UniqueName: \"kubernetes.io/projected/f096526c-ab65-40d3-b60c-577312100182-kube-api-access-hr5sv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.113138 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.113101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.113313 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.113288    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.113405 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.113384    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.123583 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.123553    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr5sv\" (UniqueName: \"kubernetes.io/projected/f096526c-ab65-40d3-b60c-577312100182-kube-api-access-hr5sv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.226096 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.226029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:43.299197 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.299168    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"]
Jul 03 09:53:43.302792 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.302771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.313259 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.313211    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"]
Jul 03 09:53:43.362018 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.361995    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"]
Jul 03 09:53:43.363623 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:53:43.363598    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf096526c_ab65_40d3_b60c_577312100182.slice/crio-2c0a2ff378c1e326f384c75581ecf1bd4666e06510a2090d4cabf3d0fcdf42ea WatchSource:0}: Error finding container 2c0a2ff378c1e326f384c75581ecf1bd4666e06510a2090d4cabf3d0fcdf42ea: Status 404 returned error can't find the container with id 2c0a2ff378c1e326f384c75581ecf1bd4666e06510a2090d4cabf3d0fcdf42ea
Jul 03 09:53:43.415444 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.415423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.417756 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.415662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.417756 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.416009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qtqp\" (UniqueName: \"kubernetes.io/projected/4f958681-4f0d-4394-b02a-3a6a304ffcdd-kube-api-access-7qtqp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.516666 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.516642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.516814 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.516693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qtqp\" (UniqueName: \"kubernetes.io/projected/4f958681-4f0d-4394-b02a-3a6a304ffcdd-kube-api-access-7qtqp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.516814 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.516753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.517049 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.517026    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.517088 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.517033    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.526517 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.526500    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qtqp\" (UniqueName: \"kubernetes.io/projected/4f958681-4f0d-4394-b02a-3a6a304ffcdd-kube-api-access-7qtqp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.551684 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.551652    2580 generic.go:356] "Generic (PLEG): container finished" podID="f096526c-ab65-40d3-b60c-577312100182" containerID="4de289a2bf5427e25a470b4b27d6b5f9d6e4671497365ef16f990dea2f1067f4" exitCode=0
Jul 03 09:53:43.551806 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.551693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc" event={"ID":"f096526c-ab65-40d3-b60c-577312100182","Type":"ContainerDied","Data":"4de289a2bf5427e25a470b4b27d6b5f9d6e4671497365ef16f990dea2f1067f4"}
Jul 03 09:53:43.551806 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.551787    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc" event={"ID":"f096526c-ab65-40d3-b60c-577312100182","Type":"ContainerStarted","Data":"2c0a2ff378c1e326f384c75581ecf1bd4666e06510a2090d4cabf3d0fcdf42ea"}
Jul 03 09:53:43.552234 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.552220    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 09:53:43.616658 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.616638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:43.698872 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.698843    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"]
Jul 03 09:53:43.702621 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.702602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.713059 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.713036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"]
Jul 03 09:53:43.743136 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.743116    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"]
Jul 03 09:53:43.745335 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:53:43.745309    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f958681_4f0d_4394_b02a_3a6a304ffcdd.slice/crio-16225f52fe871837b8bcd179e8da5da4e721a4f4831031c947a28d23e7e31229 WatchSource:0}: Error finding container 16225f52fe871837b8bcd179e8da5da4e721a4f4831031c947a28d23e7e31229: Status 404 returned error can't find the container with id 16225f52fe871837b8bcd179e8da5da4e721a4f4831031c947a28d23e7e31229
Jul 03 09:53:43.819406 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.819373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp626\" (UniqueName: \"kubernetes.io/projected/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-kube-api-access-vp626\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.819406 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.819412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.819656 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.819428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.920786 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.920727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp626\" (UniqueName: \"kubernetes.io/projected/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-kube-api-access-vp626\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.921114 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.920795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.921114 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.920811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.921188 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.921142    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.921188 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.921166    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:43.930364 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:43.930340    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp626\" (UniqueName: \"kubernetes.io/projected/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-kube-api-access-vp626\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:44.013363 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.013333    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:44.137849 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.137828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"]
Jul 03 09:53:44.140554 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:53:44.140528    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba790025_a23f_43e6_b2c5_a3c6fc9d3ac1.slice/crio-b8dd8221e91e8a033ffd5dfadade6993be6e303b17599a2fa7c7e597f0624f7c WatchSource:0}: Error finding container b8dd8221e91e8a033ffd5dfadade6993be6e303b17599a2fa7c7e597f0624f7c: Status 404 returned error can't find the container with id b8dd8221e91e8a033ffd5dfadade6993be6e303b17599a2fa7c7e597f0624f7c
Jul 03 09:53:44.296264 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.296238    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"]
Jul 03 09:53:44.299636 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.299620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.314836 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.314813    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"]
Jul 03 09:53:44.424547 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.424522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlhlj\" (UniqueName: \"kubernetes.io/projected/b79e451f-a290-4e03-959c-f1582df17857-kube-api-access-vlhlj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.424670 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.424553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.424670 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.424575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.525754 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.525702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlhlj\" (UniqueName: \"kubernetes.io/projected/b79e451f-a290-4e03-959c-f1582df17857-kube-api-access-vlhlj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.525920 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.525771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.525959 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.525926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.526161 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.526139    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.526229 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.526211    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.536412 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.536345    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlhlj\" (UniqueName: \"kubernetes.io/projected/b79e451f-a290-4e03-959c-f1582df17857-kube-api-access-vlhlj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.558186 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.558159    2580 generic.go:356] "Generic (PLEG): container finished" podID="f096526c-ab65-40d3-b60c-577312100182" containerID="1f4e5b4e8dff5b4d2085f9ebfad358e342d30de3a6c5429e20eafdb64a5f849c" exitCode=0
Jul 03 09:53:44.558317 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.558223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc" event={"ID":"f096526c-ab65-40d3-b60c-577312100182","Type":"ContainerDied","Data":"1f4e5b4e8dff5b4d2085f9ebfad358e342d30de3a6c5429e20eafdb64a5f849c"}
Jul 03 09:53:44.559769 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.559698    2580 generic.go:356] "Generic (PLEG): container finished" podID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerID="cdd6e6b2652651aecab934e69617386584b1b6de966550b3916510e76934c8b6" exitCode=0
Jul 03 09:53:44.559906 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.559823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x" event={"ID":"4f958681-4f0d-4394-b02a-3a6a304ffcdd","Type":"ContainerDied","Data":"cdd6e6b2652651aecab934e69617386584b1b6de966550b3916510e76934c8b6"}
Jul 03 09:53:44.559906 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.559865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x" event={"ID":"4f958681-4f0d-4394-b02a-3a6a304ffcdd","Type":"ContainerStarted","Data":"16225f52fe871837b8bcd179e8da5da4e721a4f4831031c947a28d23e7e31229"}
Jul 03 09:53:44.561433 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.561412    2580 generic.go:356] "Generic (PLEG): container finished" podID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerID="6cfa8eb3c407494e46ebf3f6b4645d678176e4b86eecfa6360361292a3a1372b" exitCode=0
Jul 03 09:53:44.561518 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.561435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df" event={"ID":"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1","Type":"ContainerDied","Data":"6cfa8eb3c407494e46ebf3f6b4645d678176e4b86eecfa6360361292a3a1372b"}
Jul 03 09:53:44.561518 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.561481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df" event={"ID":"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1","Type":"ContainerStarted","Data":"b8dd8221e91e8a033ffd5dfadade6993be6e303b17599a2fa7c7e597f0624f7c"}
Jul 03 09:53:44.708066 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.708043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:44.835706 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:44.835682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"]
Jul 03 09:53:44.838057 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:53:44.838033    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79e451f_a290_4e03_959c_f1582df17857.slice/crio-1704d68f00f017a96b6f0c3ebda06e07dc30f74d97d3f20b0b41081aa1bf0d0b WatchSource:0}: Error finding container 1704d68f00f017a96b6f0c3ebda06e07dc30f74d97d3f20b0b41081aa1bf0d0b: Status 404 returned error can't find the container with id 1704d68f00f017a96b6f0c3ebda06e07dc30f74d97d3f20b0b41081aa1bf0d0b
Jul 03 09:53:45.568046 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.568018    2580 generic.go:356] "Generic (PLEG): container finished" podID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerID="67cf8308197c2a4f009067fffae1597ba9309a76e1d150f0bf291dc1fe935eb0" exitCode=0
Jul 03 09:53:45.568438 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.568090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df" event={"ID":"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1","Type":"ContainerDied","Data":"67cf8308197c2a4f009067fffae1597ba9309a76e1d150f0bf291dc1fe935eb0"}
Jul 03 09:53:45.569639 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.569605    2580 generic.go:356] "Generic (PLEG): container finished" podID="b79e451f-a290-4e03-959c-f1582df17857" containerID="0a177faf00dbacde857ab2d8c750df3919a75294a71637fa1c7f9176bd807d9d" exitCode=0
Jul 03 09:53:45.569707 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.569682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv" event={"ID":"b79e451f-a290-4e03-959c-f1582df17857","Type":"ContainerDied","Data":"0a177faf00dbacde857ab2d8c750df3919a75294a71637fa1c7f9176bd807d9d"}
Jul 03 09:53:45.569772 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.569747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv" event={"ID":"b79e451f-a290-4e03-959c-f1582df17857","Type":"ContainerStarted","Data":"1704d68f00f017a96b6f0c3ebda06e07dc30f74d97d3f20b0b41081aa1bf0d0b"}
Jul 03 09:53:45.576982 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.576956    2580 generic.go:356] "Generic (PLEG): container finished" podID="f096526c-ab65-40d3-b60c-577312100182" containerID="67f97e138af6988ea151fd232b7855d236d3e4fdc4e547115234462abbde9d7f" exitCode=0
Jul 03 09:53:45.577098 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.577037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc" event={"ID":"f096526c-ab65-40d3-b60c-577312100182","Type":"ContainerDied","Data":"67f97e138af6988ea151fd232b7855d236d3e4fdc4e547115234462abbde9d7f"}
Jul 03 09:53:45.579170 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.579149    2580 generic.go:356] "Generic (PLEG): container finished" podID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerID="6820e0479b2c55c0739f2b653996355d4a2efd0d98cfc93ed53e67ca19f13808" exitCode=0
Jul 03 09:53:45.579253 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:45.579203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x" event={"ID":"4f958681-4f0d-4394-b02a-3a6a304ffcdd","Type":"ContainerDied","Data":"6820e0479b2c55c0739f2b653996355d4a2efd0d98cfc93ed53e67ca19f13808"}
Jul 03 09:53:46.586034 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.585943    2580 generic.go:356] "Generic (PLEG): container finished" podID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerID="7a1f6ccf11b38022bbc677e0adb629a433f67a58c0419fcfcbef8d7a2d56fc08" exitCode=0
Jul 03 09:53:46.586034 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.586017    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df" event={"ID":"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1","Type":"ContainerDied","Data":"7a1f6ccf11b38022bbc677e0adb629a433f67a58c0419fcfcbef8d7a2d56fc08"}
Jul 03 09:53:46.587789 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.587763    2580 generic.go:356] "Generic (PLEG): container finished" podID="b79e451f-a290-4e03-959c-f1582df17857" containerID="746ee142bcdae9863c130ce181f3ef9d15bb65d0f6dc33970e18bd2707529b92" exitCode=0
Jul 03 09:53:46.587901 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.587821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv" event={"ID":"b79e451f-a290-4e03-959c-f1582df17857","Type":"ContainerDied","Data":"746ee142bcdae9863c130ce181f3ef9d15bb65d0f6dc33970e18bd2707529b92"}
Jul 03 09:53:46.590070 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.590046    2580 generic.go:356] "Generic (PLEG): container finished" podID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerID="2fda9747334a860c7e31a1e844d8834c048aaef355f9704e2da5a8efdbaa6f69" exitCode=0
Jul 03 09:53:46.590168 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.590137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x" event={"ID":"4f958681-4f0d-4394-b02a-3a6a304ffcdd","Type":"ContainerDied","Data":"2fda9747334a860c7e31a1e844d8834c048aaef355f9704e2da5a8efdbaa6f69"}
Jul 03 09:53:46.718964 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.718936    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:46.845072 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.844984    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-bundle\") pod \"f096526c-ab65-40d3-b60c-577312100182\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") "
Jul 03 09:53:46.845072 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.845040    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hr5sv\" (UniqueName: \"kubernetes.io/projected/f096526c-ab65-40d3-b60c-577312100182-kube-api-access-hr5sv\") pod \"f096526c-ab65-40d3-b60c-577312100182\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") "
Jul 03 09:53:46.845286 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.845128    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-util\") pod \"f096526c-ab65-40d3-b60c-577312100182\" (UID: \"f096526c-ab65-40d3-b60c-577312100182\") "
Jul 03 09:53:46.845430 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.845407    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-bundle" (OuterVolumeSpecName: "bundle") pod "f096526c-ab65-40d3-b60c-577312100182" (UID: "f096526c-ab65-40d3-b60c-577312100182"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:53:46.847379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.847345    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f096526c-ab65-40d3-b60c-577312100182-kube-api-access-hr5sv" (OuterVolumeSpecName: "kube-api-access-hr5sv") pod "f096526c-ab65-40d3-b60c-577312100182" (UID: "f096526c-ab65-40d3-b60c-577312100182"). InnerVolumeSpecName "kube-api-access-hr5sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:53:46.850678 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.850657    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-util" (OuterVolumeSpecName: "util") pod "f096526c-ab65-40d3-b60c-577312100182" (UID: "f096526c-ab65-40d3-b60c-577312100182"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:53:46.946376 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.946346    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hr5sv\" (UniqueName: \"kubernetes.io/projected/f096526c-ab65-40d3-b60c-577312100182-kube-api-access-hr5sv\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:46.946376 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.946368    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-util\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:46.946376 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:46.946382    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f096526c-ab65-40d3-b60c-577312100182-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:47.597442 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.597411    2580 generic.go:356] "Generic (PLEG): container finished" podID="b79e451f-a290-4e03-959c-f1582df17857" containerID="1397addd2a72cf03dc9f2b6730f06a62387dc461bc0fdd372036cb12a60bcf19" exitCode=0
Jul 03 09:53:47.597831 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.597497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv" event={"ID":"b79e451f-a290-4e03-959c-f1582df17857","Type":"ContainerDied","Data":"1397addd2a72cf03dc9f2b6730f06a62387dc461bc0fdd372036cb12a60bcf19"}
Jul 03 09:53:47.599146 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.599124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc" event={"ID":"f096526c-ab65-40d3-b60c-577312100182","Type":"ContainerDied","Data":"2c0a2ff378c1e326f384c75581ecf1bd4666e06510a2090d4cabf3d0fcdf42ea"}
Jul 03 09:53:47.599234 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.599157    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc"
Jul 03 09:53:47.599234 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.599164    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c0a2ff378c1e326f384c75581ecf1bd4666e06510a2090d4cabf3d0fcdf42ea"
Jul 03 09:53:47.731903 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.731878    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:47.757373 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.757350    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:47.853568 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.853497    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-util\") pod \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") "
Jul 03 09:53:47.853568 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.853531    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp626\" (UniqueName: \"kubernetes.io/projected/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-kube-api-access-vp626\") pod \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") "
Jul 03 09:53:47.853568 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.853547    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-bundle\") pod \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\" (UID: \"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1\") "
Jul 03 09:53:47.853794 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.853589    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-bundle\") pod \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") "
Jul 03 09:53:47.853794 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.853699    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-util\") pod \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") "
Jul 03 09:53:47.853879 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.853807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qtqp\" (UniqueName: \"kubernetes.io/projected/4f958681-4f0d-4394-b02a-3a6a304ffcdd-kube-api-access-7qtqp\") pod \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\" (UID: \"4f958681-4f0d-4394-b02a-3a6a304ffcdd\") "
Jul 03 09:53:47.854106 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.854082    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-bundle" (OuterVolumeSpecName: "bundle") pod "4f958681-4f0d-4394-b02a-3a6a304ffcdd" (UID: "4f958681-4f0d-4394-b02a-3a6a304ffcdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:53:47.854275 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.854193    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-bundle" (OuterVolumeSpecName: "bundle") pod "ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" (UID: "ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:53:47.855644 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.855622    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-kube-api-access-vp626" (OuterVolumeSpecName: "kube-api-access-vp626") pod "ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" (UID: "ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1"). InnerVolumeSpecName "kube-api-access-vp626". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:53:47.856223 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.856200    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f958681-4f0d-4394-b02a-3a6a304ffcdd-kube-api-access-7qtqp" (OuterVolumeSpecName: "kube-api-access-7qtqp") pod "4f958681-4f0d-4394-b02a-3a6a304ffcdd" (UID: "4f958681-4f0d-4394-b02a-3a6a304ffcdd"). InnerVolumeSpecName "kube-api-access-7qtqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:53:47.859562 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.859533    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-util" (OuterVolumeSpecName: "util") pod "4f958681-4f0d-4394-b02a-3a6a304ffcdd" (UID: "4f958681-4f0d-4394-b02a-3a6a304ffcdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:53:47.860003 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.859985    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-util" (OuterVolumeSpecName: "util") pod "ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" (UID: "ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:53:47.954770 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.954717    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-util\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:47.954907 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.954787    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qtqp\" (UniqueName: \"kubernetes.io/projected/4f958681-4f0d-4394-b02a-3a6a304ffcdd-kube-api-access-7qtqp\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:47.954907 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.954798    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-util\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:47.954907 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.954808    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp626\" (UniqueName: \"kubernetes.io/projected/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-kube-api-access-vp626\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:47.954907 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.954816    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:47.954907 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:47.954826    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f958681-4f0d-4394-b02a-3a6a304ffcdd-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:48.605441 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.605415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x"
Jul 03 09:53:48.605855 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.605440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x" event={"ID":"4f958681-4f0d-4394-b02a-3a6a304ffcdd","Type":"ContainerDied","Data":"16225f52fe871837b8bcd179e8da5da4e721a4f4831031c947a28d23e7e31229"}
Jul 03 09:53:48.605855 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.605492    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16225f52fe871837b8bcd179e8da5da4e721a4f4831031c947a28d23e7e31229"
Jul 03 09:53:48.607325 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.607296    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df" event={"ID":"ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1","Type":"ContainerDied","Data":"b8dd8221e91e8a033ffd5dfadade6993be6e303b17599a2fa7c7e597f0624f7c"}
Jul 03 09:53:48.607446 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.607325    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df"
Jul 03 09:53:48.607446 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.607338    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8dd8221e91e8a033ffd5dfadade6993be6e303b17599a2fa7c7e597f0624f7c"
Jul 03 09:53:48.729315 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.729291    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:48.860322 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.860234    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-util\") pod \"b79e451f-a290-4e03-959c-f1582df17857\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") "
Jul 03 09:53:48.860322 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.860292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlhlj\" (UniqueName: \"kubernetes.io/projected/b79e451f-a290-4e03-959c-f1582df17857-kube-api-access-vlhlj\") pod \"b79e451f-a290-4e03-959c-f1582df17857\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") "
Jul 03 09:53:48.860322 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.860324    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-bundle\") pod \"b79e451f-a290-4e03-959c-f1582df17857\" (UID: \"b79e451f-a290-4e03-959c-f1582df17857\") "
Jul 03 09:53:48.860998 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.860974    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-bundle" (OuterVolumeSpecName: "bundle") pod "b79e451f-a290-4e03-959c-f1582df17857" (UID: "b79e451f-a290-4e03-959c-f1582df17857"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:53:48.862369 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.862343    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b79e451f-a290-4e03-959c-f1582df17857-kube-api-access-vlhlj" (OuterVolumeSpecName: "kube-api-access-vlhlj") pod "b79e451f-a290-4e03-959c-f1582df17857" (UID: "b79e451f-a290-4e03-959c-f1582df17857"). InnerVolumeSpecName "kube-api-access-vlhlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:53:48.865588 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.865566    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-util" (OuterVolumeSpecName: "util") pod "b79e451f-a290-4e03-959c-f1582df17857" (UID: "b79e451f-a290-4e03-959c-f1582df17857"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:53:48.961263 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.961232    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-util\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:48.961263 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.961259    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlhlj\" (UniqueName: \"kubernetes.io/projected/b79e451f-a290-4e03-959c-f1582df17857-kube-api-access-vlhlj\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:48.961431 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:48.961269    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b79e451f-a290-4e03-959c-f1582df17857-bundle\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:53:49.614570 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:49.614546    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv"
Jul 03 09:53:49.614935 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:49.614564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv" event={"ID":"b79e451f-a290-4e03-959c-f1582df17857","Type":"ContainerDied","Data":"1704d68f00f017a96b6f0c3ebda06e07dc30f74d97d3f20b0b41081aa1bf0d0b"}
Jul 03 09:53:49.614935 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:53:49.614608    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1704d68f00f017a96b6f0c3ebda06e07dc30f74d97d3f20b0b41081aa1bf0d0b"
Jul 03 09:55:50.375472 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375439    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c9895fc89-cpq7v"]
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375785    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerName="pull"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375797    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerName="pull"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375809    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f096526c-ab65-40d3-b60c-577312100182" containerName="util"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375816    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f096526c-ab65-40d3-b60c-577312100182" containerName="util"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375826    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f096526c-ab65-40d3-b60c-577312100182" containerName="pull"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375833    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f096526c-ab65-40d3-b60c-577312100182" containerName="pull"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375844    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f096526c-ab65-40d3-b60c-577312100182" containerName="extract"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375849    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f096526c-ab65-40d3-b60c-577312100182" containerName="extract"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375855    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79e451f-a290-4e03-959c-f1582df17857" containerName="util"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375861    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79e451f-a290-4e03-959c-f1582df17857" containerName="util"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375868    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerName="extract"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375874    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerName="extract"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375882    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerName="util"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375888    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerName="util"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375895    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79e451f-a290-4e03-959c-f1582df17857" containerName="extract"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375903    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79e451f-a290-4e03-959c-f1582df17857" containerName="extract"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375914    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerName="extract"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375918    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerName="extract"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375925    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerName="util"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375930    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerName="util"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375935    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerName="pull"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375940    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerName="pull"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375945    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b79e451f-a290-4e03-959c-f1582df17857" containerName="pull"
Jul 03 09:55:50.375937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.375950    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b79e451f-a290-4e03-959c-f1582df17857" containerName="pull"
Jul 03 09:55:50.376675 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.376007    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1" containerName="extract"
Jul 03 09:55:50.376675 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.376021    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f096526c-ab65-40d3-b60c-577312100182" containerName="extract"
Jul 03 09:55:50.376675 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.376027    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b79e451f-a290-4e03-959c-f1582df17857" containerName="extract"
Jul 03 09:55:50.376675 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.376036    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f958681-4f0d-4394-b02a-3a6a304ffcdd" containerName="extract"
Jul 03 09:55:50.378945 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.378929    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:50.381784 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.381755    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 03 09:55:50.381893 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.381818    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 03 09:55:50.381937 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.381924    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fs7sk\""
Jul 03 09:55:50.389379 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.389359    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c9895fc89-cpq7v"]
Jul 03 09:55:50.435445 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.435419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a74c1775-a64d-48ce-9589-3b65f183bf63-webhook-cert\") pod \"maas-controller-c9895fc89-cpq7v\" (UID: \"a74c1775-a64d-48ce-9589-3b65f183bf63\") " pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:50.435576 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.435455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gjhc\" (UniqueName: \"kubernetes.io/projected/a74c1775-a64d-48ce-9589-3b65f183bf63-kube-api-access-2gjhc\") pod \"maas-controller-c9895fc89-cpq7v\" (UID: \"a74c1775-a64d-48ce-9589-3b65f183bf63\") " pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:50.536024 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.535995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a74c1775-a64d-48ce-9589-3b65f183bf63-webhook-cert\") pod \"maas-controller-c9895fc89-cpq7v\" (UID: \"a74c1775-a64d-48ce-9589-3b65f183bf63\") " pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:50.536171 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.536029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gjhc\" (UniqueName: \"kubernetes.io/projected/a74c1775-a64d-48ce-9589-3b65f183bf63-kube-api-access-2gjhc\") pod \"maas-controller-c9895fc89-cpq7v\" (UID: \"a74c1775-a64d-48ce-9589-3b65f183bf63\") " pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:50.538507 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.538479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a74c1775-a64d-48ce-9589-3b65f183bf63-webhook-cert\") pod \"maas-controller-c9895fc89-cpq7v\" (UID: \"a74c1775-a64d-48ce-9589-3b65f183bf63\") " pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:50.547528 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.547499    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gjhc\" (UniqueName: \"kubernetes.io/projected/a74c1775-a64d-48ce-9589-3b65f183bf63-kube-api-access-2gjhc\") pod \"maas-controller-c9895fc89-cpq7v\" (UID: \"a74c1775-a64d-48ce-9589-3b65f183bf63\") " pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:50.550176 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.550155    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-vs7s6"]
Jul 03 09:55:50.553652 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.553624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:50.563458 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.563433    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-vs7s6"]
Jul 03 09:55:50.637455 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.637391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvjj8\" (UniqueName: \"kubernetes.io/projected/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-kube-api-access-dvjj8\") pod \"maas-controller-74cfb6d5d8-vs7s6\" (UID: \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\") " pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:50.637455 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.637427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-webhook-cert\") pod \"maas-controller-74cfb6d5d8-vs7s6\" (UID: \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\") " pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:50.690193 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.690159    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:50.738290 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.738264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvjj8\" (UniqueName: \"kubernetes.io/projected/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-kube-api-access-dvjj8\") pod \"maas-controller-74cfb6d5d8-vs7s6\" (UID: \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\") " pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:50.738439 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.738319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-webhook-cert\") pod \"maas-controller-74cfb6d5d8-vs7s6\" (UID: \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\") " pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:50.740821 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.740800    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-webhook-cert\") pod \"maas-controller-74cfb6d5d8-vs7s6\" (UID: \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\") " pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:50.749956 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.749929    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvjj8\" (UniqueName: \"kubernetes.io/projected/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-kube-api-access-dvjj8\") pod \"maas-controller-74cfb6d5d8-vs7s6\" (UID: \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\") " pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:50.821643 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.819522    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c9895fc89-cpq7v"]
Jul 03 09:55:50.864301 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.864275    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:50.989405 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:50.989378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-vs7s6"]
Jul 03 09:55:50.990911 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:55:50.990888    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb78f4d0_7dd9_4851_b0d5_f1be16fd315d.slice/crio-c04a882a4a61e86cb2c62eedb32a66aeae6cad426d8520b457c96a56d485cc1f WatchSource:0}: Error finding container c04a882a4a61e86cb2c62eedb32a66aeae6cad426d8520b457c96a56d485cc1f: Status 404 returned error can't find the container with id c04a882a4a61e86cb2c62eedb32a66aeae6cad426d8520b457c96a56d485cc1f
Jul 03 09:55:51.180565 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:51.180480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6" event={"ID":"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d","Type":"ContainerStarted","Data":"c04a882a4a61e86cb2c62eedb32a66aeae6cad426d8520b457c96a56d485cc1f"}
Jul 03 09:55:51.181613 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:51.181582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9895fc89-cpq7v" event={"ID":"a74c1775-a64d-48ce-9589-3b65f183bf63","Type":"ContainerStarted","Data":"6bcce359704b3038ce72671a8c17011fea1f3d8293398dda166d67c10f737a5b"}
Jul 03 09:55:53.197024 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:53.196935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6" event={"ID":"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d","Type":"ContainerStarted","Data":"2f06ee1c0ae1b6acad7a2a7034b7fce483066c1c8b944168dabc2100e417f1fa"}
Jul 03 09:55:53.197493 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:53.197031    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:55:53.198578 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:53.198555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9895fc89-cpq7v" event={"ID":"a74c1775-a64d-48ce-9589-3b65f183bf63","Type":"ContainerStarted","Data":"0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93"}
Jul 03 09:55:53.198691 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:53.198615    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:55:53.230233 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:53.230190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6" podStartSLOduration=1.279691328 podStartE2EDuration="3.230177328s" totalImagesPullingTime="1.950486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:55:53.227832375 +0000 UTC m=+757.396307776" watchObservedRunningTime="2026-07-03 09:55:53.230177328 +0000 UTC m=+757.398652728"
Jul 03 09:55:53.260622 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:55:53.260580    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c9895fc89-cpq7v" podStartSLOduration=1.151198632 podStartE2EDuration="3.260566982s" totalImagesPullingTime="2.10936835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:55:53.2573938 +0000 UTC m=+757.425869200" watchObservedRunningTime="2026-07-03 09:55:53.260566982 +0000 UTC m=+757.429042384"
Jul 03 09:56:04.208766 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.208718    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 09:56:04.209122 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.208807    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:56:04.342442 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.342403    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c9895fc89-cpq7v"]
Jul 03 09:56:04.342613 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.342577    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c9895fc89-cpq7v" podUID="a74c1775-a64d-48ce-9589-3b65f183bf63" containerName="manager" containerID="cri-o://0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93" gracePeriod=30
Jul 03 09:56:04.581378 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.581358    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:56:04.658160 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.658132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a74c1775-a64d-48ce-9589-3b65f183bf63-webhook-cert\") pod \"a74c1775-a64d-48ce-9589-3b65f183bf63\" (UID: \"a74c1775-a64d-48ce-9589-3b65f183bf63\") "
Jul 03 09:56:04.658310 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.658166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gjhc\" (UniqueName: \"kubernetes.io/projected/a74c1775-a64d-48ce-9589-3b65f183bf63-kube-api-access-2gjhc\") pod \"a74c1775-a64d-48ce-9589-3b65f183bf63\" (UID: \"a74c1775-a64d-48ce-9589-3b65f183bf63\") "
Jul 03 09:56:04.660323 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.660290    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a74c1775-a64d-48ce-9589-3b65f183bf63-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a74c1775-a64d-48ce-9589-3b65f183bf63" (UID: "a74c1775-a64d-48ce-9589-3b65f183bf63"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:56:04.660423 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.660323    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a74c1775-a64d-48ce-9589-3b65f183bf63-kube-api-access-2gjhc" (OuterVolumeSpecName: "kube-api-access-2gjhc") pod "a74c1775-a64d-48ce-9589-3b65f183bf63" (UID: "a74c1775-a64d-48ce-9589-3b65f183bf63"). InnerVolumeSpecName "kube-api-access-2gjhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:56:04.759635 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.759613    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a74c1775-a64d-48ce-9589-3b65f183bf63-webhook-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:56:04.759635 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:04.759635    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gjhc\" (UniqueName: \"kubernetes.io/projected/a74c1775-a64d-48ce-9589-3b65f183bf63-kube-api-access-2gjhc\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 09:56:05.256192 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.256117    2580 generic.go:356] "Generic (PLEG): container finished" podID="a74c1775-a64d-48ce-9589-3b65f183bf63" containerID="0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93" exitCode=0
Jul 03 09:56:05.256192 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.256162    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c9895fc89-cpq7v"
Jul 03 09:56:05.256192 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.256184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9895fc89-cpq7v" event={"ID":"a74c1775-a64d-48ce-9589-3b65f183bf63","Type":"ContainerDied","Data":"0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93"}
Jul 03 09:56:05.256644 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.256226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c9895fc89-cpq7v" event={"ID":"a74c1775-a64d-48ce-9589-3b65f183bf63","Type":"ContainerDied","Data":"6bcce359704b3038ce72671a8c17011fea1f3d8293398dda166d67c10f737a5b"}
Jul 03 09:56:05.256644 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.256246    2580 scope.go:117] "RemoveContainer" containerID="0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93"
Jul 03 09:56:05.265241 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.265225    2580 scope.go:117] "RemoveContainer" containerID="0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93"
Jul 03 09:56:05.265479 ip-10-0-138-110 kubenswrapper[2580]: E0703 09:56:05.265459    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93\": container with ID starting with 0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93 not found: ID does not exist" containerID="0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93"
Jul 03 09:56:05.265527 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.265488    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93"} err="failed to get container status \"0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93\": rpc error: code = NotFound desc = could not find container \"0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93\": container with ID starting with 0f4c49b1bd793eafacaa9fc4af13dcc5e90629002afae2bcc897674bbe838d93 not found: ID does not exist"
Jul 03 09:56:05.277265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.277243    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c9895fc89-cpq7v"]
Jul 03 09:56:05.281095 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:05.281072    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c9895fc89-cpq7v"]
Jul 03 09:56:06.289294 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:06.289263    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a74c1775-a64d-48ce-9589-3b65f183bf63" path="/var/lib/kubelet/pods/a74c1775-a64d-48ce-9589-3b65f183bf63/volumes"
Jul 03 09:56:26.019345 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.019309    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kkr7c"]
Jul 03 09:56:26.019924 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.019758    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74c1775-a64d-48ce-9589-3b65f183bf63" containerName="manager"
Jul 03 09:56:26.019924 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.019776    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74c1775-a64d-48ce-9589-3b65f183bf63" containerName="manager"
Jul 03 09:56:26.019924 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.019856    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a74c1775-a64d-48ce-9589-3b65f183bf63" containerName="manager"
Jul 03 09:56:26.024152 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.024132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:26.026668 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.026646    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zd4bk\""
Jul 03 09:56:26.026794 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.026711    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 03 09:56:26.032551 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.032507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6477f5-aa6e-4053-a42d-0d7a29c0818c-plugins-config-volume\") pod \"payload-processing-58f86c7798-kkr7c\" (UID: \"de6477f5-aa6e-4053-a42d-0d7a29c0818c\") " pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:26.032831 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.032795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkdc5\" (UniqueName: \"kubernetes.io/projected/de6477f5-aa6e-4053-a42d-0d7a29c0818c-kube-api-access-tkdc5\") pod \"payload-processing-58f86c7798-kkr7c\" (UID: \"de6477f5-aa6e-4053-a42d-0d7a29c0818c\") " pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:26.034727 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.034706    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kkr7c"]
Jul 03 09:56:26.133480 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.133451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6477f5-aa6e-4053-a42d-0d7a29c0818c-plugins-config-volume\") pod \"payload-processing-58f86c7798-kkr7c\" (UID: \"de6477f5-aa6e-4053-a42d-0d7a29c0818c\") " pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:26.133649 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.133507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkdc5\" (UniqueName: \"kubernetes.io/projected/de6477f5-aa6e-4053-a42d-0d7a29c0818c-kube-api-access-tkdc5\") pod \"payload-processing-58f86c7798-kkr7c\" (UID: \"de6477f5-aa6e-4053-a42d-0d7a29c0818c\") " pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:26.134497 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.134432    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6477f5-aa6e-4053-a42d-0d7a29c0818c-plugins-config-volume\") pod \"payload-processing-58f86c7798-kkr7c\" (UID: \"de6477f5-aa6e-4053-a42d-0d7a29c0818c\") " pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:26.141685 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.141662    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkdc5\" (UniqueName: \"kubernetes.io/projected/de6477f5-aa6e-4053-a42d-0d7a29c0818c-kube-api-access-tkdc5\") pod \"payload-processing-58f86c7798-kkr7c\" (UID: \"de6477f5-aa6e-4053-a42d-0d7a29c0818c\") " pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:26.334519 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.334430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:26.467006 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:26.466982    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-kkr7c"]
Jul 03 09:56:26.468922 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:56:26.468896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6477f5_aa6e_4053_a42d_0d7a29c0818c.slice/crio-43d391dcb7f9cf793ef7267d907a4c13246267648be35d8c6460b900177ad9e3 WatchSource:0}: Error finding container 43d391dcb7f9cf793ef7267d907a4c13246267648be35d8c6460b900177ad9e3: Status 404 returned error can't find the container with id 43d391dcb7f9cf793ef7267d907a4c13246267648be35d8c6460b900177ad9e3
Jul 03 09:56:27.365427 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:27.365394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-kkr7c" event={"ID":"de6477f5-aa6e-4053-a42d-0d7a29c0818c","Type":"ContainerStarted","Data":"43d391dcb7f9cf793ef7267d907a4c13246267648be35d8c6460b900177ad9e3"}
Jul 03 09:56:28.371678 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:28.371641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-kkr7c" event={"ID":"de6477f5-aa6e-4053-a42d-0d7a29c0818c","Type":"ContainerStarted","Data":"049b204d30cc67f17905a8207924cd79fb6d14cede1f1a962d13730ae6df3cfc"}
Jul 03 09:56:28.372072 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:28.371840    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:56:28.389371 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:28.389328    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-kkr7c" podStartSLOduration=1.055015113 podStartE2EDuration="2.389309495s" totalImagesPullingTime="1.334294382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:56:28.387810311 +0000 UTC m=+792.556285725" watchObservedRunningTime="2026-07-03 09:56:28.389309495 +0000 UTC m=+792.557784897"
Jul 03 09:56:39.379123 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:56:39.379046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-kkr7c"
Jul 03 09:57:06.501489 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.501457    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"]
Jul 03 09:57:06.505813 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.505793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.509532 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.509509    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 03 09:57:06.509532 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.509528    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m2wrc\""
Jul 03 09:57:06.509683 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.509511    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 03 09:57:06.509683 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.509575    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 03 09:57:06.516207 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.516189    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"]
Jul 03 09:57:06.645571 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.645539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.645571 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.645574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.645855 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.645594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.645855 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.645671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/199e858c-007f-4510-a91a-e94d992ea99e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.645855 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.645712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.645855 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.645778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8px\" (UniqueName: \"kubernetes.io/projected/199e858c-007f-4510-a91a-e94d992ea99e-kube-api-access-5n8px\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746239 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746239 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746468 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746468 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/199e858c-007f-4510-a91a-e94d992ea99e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746468 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746468 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8px\" (UniqueName: \"kubernetes.io/projected/199e858c-007f-4510-a91a-e94d992ea99e-kube-api-access-5n8px\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746658 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746635    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746756 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746713    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.746861 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.746844    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.748501 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.748479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/199e858c-007f-4510-a91a-e94d992ea99e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.748792 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.748775    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/199e858c-007f-4510-a91a-e94d992ea99e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.756512 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.756457    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8px\" (UniqueName: \"kubernetes.io/projected/199e858c-007f-4510-a91a-e94d992ea99e-kube-api-access-5n8px\") pod \"e2e-trlp-test-simulated-kserve-598466548d-cgspg\" (UID: \"199e858c-007f-4510-a91a-e94d992ea99e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.816565 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.816544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:06.957577 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:06.957556    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"]
Jul 03 09:57:06.959251 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:57:06.959226    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199e858c_007f_4510_a91a_e94d992ea99e.slice/crio-e068d1f0690c3441bd5e953d7122b9a06dee28757d7cece400d0f5fc5ac005d7 WatchSource:0}: Error finding container e068d1f0690c3441bd5e953d7122b9a06dee28757d7cece400d0f5fc5ac005d7: Status 404 returned error can't find the container with id e068d1f0690c3441bd5e953d7122b9a06dee28757d7cece400d0f5fc5ac005d7
Jul 03 09:57:07.560249 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:07.560192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg" event={"ID":"199e858c-007f-4510-a91a-e94d992ea99e","Type":"ContainerStarted","Data":"e068d1f0690c3441bd5e953d7122b9a06dee28757d7cece400d0f5fc5ac005d7"}
Jul 03 09:57:08.566452 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:08.566406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg" event={"ID":"199e858c-007f-4510-a91a-e94d992ea99e","Type":"ContainerStarted","Data":"7a918e8f9020b8aee396d0440cd170e8c2a5e7a807b7364215e6da5aceb5c01f"}
Jul 03 09:57:08.585666 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:08.585612    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg" podStartSLOduration=1.496654814 podStartE2EDuration="2.585596642s" totalImagesPullingTime="1.088941828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:57:08.584128596 +0000 UTC m=+832.752604001" watchObservedRunningTime="2026-07-03 09:57:08.585596642 +0000 UTC m=+832.754072060"
Jul 03 09:57:16.816834 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:16.816800    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:16.817241 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:16.816860    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:16.829211 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:16.829191    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:17.618076 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:17.618044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-cgspg"
Jul 03 09:57:49.310068 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.310035    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"]
Jul 03 09:57:49.312501 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.312478    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.315256 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.315233    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 03 09:57:49.334262 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.334235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"]
Jul 03 09:57:49.367706 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.367673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48w6h\" (UniqueName: \"kubernetes.io/projected/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-kube-api-access-48w6h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.367706 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.367710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.367931 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.367726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.367931 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.367814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.367931 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.367840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.367931 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.367930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.468384 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.468553 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48w6h\" (UniqueName: \"kubernetes.io/projected/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-kube-api-access-48w6h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.468553 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.468553 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.468553 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.468553 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.468914 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468890    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.468976 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468936    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.469013 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.468968    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.470661 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.470636    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.470892 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.470873    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.480265 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.480243    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48w6h\" (UniqueName: \"kubernetes.io/projected/cfce06ce-c17c-4ef0-8236-6351d6cb8f27-kube-api-access-48w6h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-t9fzv\" (UID: \"cfce06ce-c17c-4ef0-8236-6351d6cb8f27\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.622430 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.622398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:49.756005 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:49.755982    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"]
Jul 03 09:57:49.757263 ip-10-0-138-110 kubenswrapper[2580]: W0703 09:57:49.757236    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfce06ce_c17c_4ef0_8236_6351d6cb8f27.slice/crio-d3156361e5af8367d4478cd633a5f4e725168c9cb184cb5e5acb93fc92828c9c WatchSource:0}: Error finding container d3156361e5af8367d4478cd633a5f4e725168c9cb184cb5e5acb93fc92828c9c: Status 404 returned error can't find the container with id d3156361e5af8367d4478cd633a5f4e725168c9cb184cb5e5acb93fc92828c9c
Jul 03 09:57:50.768294 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:50.768261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv" event={"ID":"cfce06ce-c17c-4ef0-8236-6351d6cb8f27","Type":"ContainerStarted","Data":"f977b9e7d2185e9d185fc6d8d9ddf9a7aedafd3fbcd273c6934676f6b8f9e91e"}
Jul 03 09:57:50.768775 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:50.768323    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv" event={"ID":"cfce06ce-c17c-4ef0-8236-6351d6cb8f27","Type":"ContainerStarted","Data":"d3156361e5af8367d4478cd633a5f4e725168c9cb184cb5e5acb93fc92828c9c"}
Jul 03 09:57:50.787399 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:50.787355    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv" podStartSLOduration=1.5735362849999999 podStartE2EDuration="1.787339886s" totalImagesPullingTime="213.803601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:57:50.78514938 +0000 UTC m=+874.953624780" watchObservedRunningTime="2026-07-03 09:57:50.787339886 +0000 UTC m=+874.955815291"
Jul 03 09:57:59.622633 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:59.622595    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:59.623151 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:59.622668    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:59.635038 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:59.635016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 09:57:59.827468 ip-10-0-138-110 kubenswrapper[2580]: I0703 09:57:59.827442    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-t9fzv"
Jul 03 10:00:07.185892 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.185855    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-vs7s6"]
Jul 03 10:00:07.186332 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.186066    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6" podUID="eb78f4d0-7dd9-4851-b0d5-f1be16fd315d" containerName="manager" containerID="cri-o://2f06ee1c0ae1b6acad7a2a7034b7fce483066c1c8b944168dabc2100e417f1fa" gracePeriod=30
Jul 03 10:00:07.426087 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.426052    2580 generic.go:356] "Generic (PLEG): container finished" podID="eb78f4d0-7dd9-4851-b0d5-f1be16fd315d" containerID="2f06ee1c0ae1b6acad7a2a7034b7fce483066c1c8b944168dabc2100e417f1fa" exitCode=0
Jul 03 10:00:07.426220 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.426129    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6" event={"ID":"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d","Type":"ContainerDied","Data":"2f06ee1c0ae1b6acad7a2a7034b7fce483066c1c8b944168dabc2100e417f1fa"}
Jul 03 10:00:07.426220 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.426183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6" event={"ID":"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d","Type":"ContainerDied","Data":"c04a882a4a61e86cb2c62eedb32a66aeae6cad426d8520b457c96a56d485cc1f"}
Jul 03 10:00:07.426220 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.426202    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c04a882a4a61e86cb2c62eedb32a66aeae6cad426d8520b457c96a56d485cc1f"
Jul 03 10:00:07.429082 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.429062    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 10:00:07.495645 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.495566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-webhook-cert\") pod \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\" (UID: \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\") "
Jul 03 10:00:07.495645 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.495615    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvjj8\" (UniqueName: \"kubernetes.io/projected/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-kube-api-access-dvjj8\") pod \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\" (UID: \"eb78f4d0-7dd9-4851-b0d5-f1be16fd315d\") "
Jul 03 10:00:07.497575 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.497542    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eb78f4d0-7dd9-4851-b0d5-f1be16fd315d" (UID: "eb78f4d0-7dd9-4851-b0d5-f1be16fd315d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:00:07.497575 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.497563    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-kube-api-access-dvjj8" (OuterVolumeSpecName: "kube-api-access-dvjj8") pod "eb78f4d0-7dd9-4851-b0d5-f1be16fd315d" (UID: "eb78f4d0-7dd9-4851-b0d5-f1be16fd315d"). InnerVolumeSpecName "kube-api-access-dvjj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:00:07.596673 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.596639    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-webhook-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:00:07.596673 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:07.596666    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvjj8\" (UniqueName: \"kubernetes.io/projected/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d-kube-api-access-dvjj8\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:00:08.430584 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:08.430547    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cfb6d5d8-vs7s6"
Jul 03 10:00:08.447844 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:08.447815    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-vs7s6"]
Jul 03 10:00:08.452346 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:08.452321    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-vs7s6"]
Jul 03 10:00:09.267591 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.267552    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-j6b9t"]
Jul 03 10:00:09.267948 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.267934    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb78f4d0-7dd9-4851-b0d5-f1be16fd315d" containerName="manager"
Jul 03 10:00:09.267996 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.267951    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb78f4d0-7dd9-4851-b0d5-f1be16fd315d" containerName="manager"
Jul 03 10:00:09.268035 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.268009    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb78f4d0-7dd9-4851-b0d5-f1be16fd315d" containerName="manager"
Jul 03 10:00:09.270993 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.270979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:09.274101 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.274070    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fs7sk\""
Jul 03 10:00:09.274101 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.274074    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 03 10:00:09.274272 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.274109    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 03 10:00:09.280192 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.280171    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-j6b9t"]
Jul 03 10:00:09.310470 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.310445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgl9l\" (UniqueName: \"kubernetes.io/projected/d0277d5e-3316-4d03-a7b5-83bcd4a274c5-kube-api-access-pgl9l\") pod \"maas-controller-74cfb6d5d8-j6b9t\" (UID: \"d0277d5e-3316-4d03-a7b5-83bcd4a274c5\") " pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:09.310576 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.310497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0277d5e-3316-4d03-a7b5-83bcd4a274c5-webhook-cert\") pod \"maas-controller-74cfb6d5d8-j6b9t\" (UID: \"d0277d5e-3316-4d03-a7b5-83bcd4a274c5\") " pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:09.411625 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.411599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0277d5e-3316-4d03-a7b5-83bcd4a274c5-webhook-cert\") pod \"maas-controller-74cfb6d5d8-j6b9t\" (UID: \"d0277d5e-3316-4d03-a7b5-83bcd4a274c5\") " pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:09.411793 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.411660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgl9l\" (UniqueName: \"kubernetes.io/projected/d0277d5e-3316-4d03-a7b5-83bcd4a274c5-kube-api-access-pgl9l\") pod \"maas-controller-74cfb6d5d8-j6b9t\" (UID: \"d0277d5e-3316-4d03-a7b5-83bcd4a274c5\") " pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:09.414010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.413992    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d0277d5e-3316-4d03-a7b5-83bcd4a274c5-webhook-cert\") pod \"maas-controller-74cfb6d5d8-j6b9t\" (UID: \"d0277d5e-3316-4d03-a7b5-83bcd4a274c5\") " pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:09.420608 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.420581    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgl9l\" (UniqueName: \"kubernetes.io/projected/d0277d5e-3316-4d03-a7b5-83bcd4a274c5-kube-api-access-pgl9l\") pod \"maas-controller-74cfb6d5d8-j6b9t\" (UID: \"d0277d5e-3316-4d03-a7b5-83bcd4a274c5\") " pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:09.582958 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.582876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:09.714075 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.714046    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74cfb6d5d8-j6b9t"]
Jul 03 10:00:09.716690 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:00:09.716662    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0277d5e_3316_4d03_a7b5_83bcd4a274c5.slice/crio-1d969aae465ab549c22a4eb0fe86413cbaa6f40bb2ee0d429c4d17c701af286c WatchSource:0}: Error finding container 1d969aae465ab549c22a4eb0fe86413cbaa6f40bb2ee0d429c4d17c701af286c: Status 404 returned error can't find the container with id 1d969aae465ab549c22a4eb0fe86413cbaa6f40bb2ee0d429c4d17c701af286c
Jul 03 10:00:09.718003 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:09.717983    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 10:00:10.289423 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:10.289385    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb78f4d0-7dd9-4851-b0d5-f1be16fd315d" path="/var/lib/kubelet/pods/eb78f4d0-7dd9-4851-b0d5-f1be16fd315d/volumes"
Jul 03 10:00:10.441297 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:10.441266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t" event={"ID":"d0277d5e-3316-4d03-a7b5-83bcd4a274c5","Type":"ContainerStarted","Data":"1d969aae465ab549c22a4eb0fe86413cbaa6f40bb2ee0d429c4d17c701af286c"}
Jul 03 10:00:11.447519 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:11.447436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t" event={"ID":"d0277d5e-3316-4d03-a7b5-83bcd4a274c5","Type":"ContainerStarted","Data":"129207eec5e7818805a5ab2fa6f06f218aaffef6cb5a61119d9d7d956d17f97d"}
Jul 03 10:00:11.447519 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:11.447494    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:00:11.469714 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:11.469670    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t" podStartSLOduration=1.096510052 podStartE2EDuration="2.46965576s" totalImagesPullingTime="1.373145708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:00:11.46491915 +0000 UTC m=+1015.633394562" watchObservedRunningTime="2026-07-03 10:00:11.46965576 +0000 UTC m=+1015.638131160"
Jul 03 10:00:22.457992 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:00:22.457960    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74cfb6d5d8-j6b9t"
Jul 03 10:02:16.295346 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:02:16.295317    2580 scope.go:117] "RemoveContainer" containerID="2f06ee1c0ae1b6acad7a2a7034b7fce483066c1c8b944168dabc2100e417f1fa"
Jul 03 10:12:09.656412 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.656374    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"]
Jul 03 10:12:09.659639 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.659618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.662799 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.662780    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-375f3f4c-openshift-default-dockercfg-92f8x\""
Jul 03 10:12:09.724880 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.724848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-data\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.725006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.724902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istiod-ca-cert\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.725006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.724922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-credential-socket\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.725006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.724949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-podinfo\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.725006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.724974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-certs\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.725156 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.725011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-token\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.725156 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.725074    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-socket\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.725156 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.725093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v2pq\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-kube-api-access-8v2pq\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.725156 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.725128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-envoy\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.741087 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.741059    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"]
Jul 03 10:12:09.825754 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.825707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-podinfo\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.825960 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.825775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-certs\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.825960 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.825794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-token\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.825960 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.825821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-socket\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.825960 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.825837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2pq\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-kube-api-access-8v2pq\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.825960 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.825866    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-envoy\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.825960 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.825914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-data\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.826272 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.825982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istiod-ca-cert\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.826272 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.826005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-credential-socket\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.826383 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.826272    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-certs\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.826383 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.826329    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-socket\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.826493 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.826426    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-credential-socket\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.826493 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.826451    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-data\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.826681 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.826660    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istiod-ca-cert\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.828139 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.828118    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-envoy\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.828269 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.828254    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-podinfo\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.835353 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.835331    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v2pq\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-kube-api-access-8v2pq\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.835706 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.835691    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-token\") pod \"e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") " pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:09.969994 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:09.969919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:10.111347 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:10.111317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"]
Jul 03 10:12:10.113312 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:12:10.113287    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a71e7b_c73c_4c9c_a810_fce3e641ab08.slice/crio-35e26d27c1040f880256c0f9f0e95c767e379c36cb11425464cec7fc05bcf3ee WatchSource:0}: Error finding container 35e26d27c1040f880256c0f9f0e95c767e379c36cb11425464cec7fc05bcf3ee: Status 404 returned error can't find the container with id 35e26d27c1040f880256c0f9f0e95c767e379c36cb11425464cec7fc05bcf3ee
Jul 03 10:12:10.115544 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:10.115514    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:10.115613 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:10.115574    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:10.115613 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:10.115602    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:10.940866 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:10.940833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr" event={"ID":"01a71e7b-c73c-4c9c-a810-fce3e641ab08","Type":"ContainerStarted","Data":"3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2"}
Jul 03 10:12:10.941221 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:10.940917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr" event={"ID":"01a71e7b-c73c-4c9c-a810-fce3e641ab08","Type":"ContainerStarted","Data":"35e26d27c1040f880256c0f9f0e95c767e379c36cb11425464cec7fc05bcf3ee"}
Jul 03 10:12:10.970068 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:10.970026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:10.970786 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:10.970719    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr" podStartSLOduration=1.970705881 podStartE2EDuration="1.970705881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:12:10.970017332 +0000 UTC m=+1735.138492730" watchObservedRunningTime="2026-07-03 10:12:10.970705881 +0000 UTC m=+1735.139181283"
Jul 03 10:12:11.975635 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:11.975602    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:12.950429 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:12.950401    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:12.951415 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:12.951398    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:16.061103 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:16.061070    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"]
Jul 03 10:12:16.061572 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:16.061290    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr" podUID="01a71e7b-c73c-4c9c-a810-fce3e641ab08" containerName="istio-proxy" containerID="cri-o://3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2" gracePeriod=30
Jul 03 10:12:21.314610 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.314584    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:21.429430 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-podinfo\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.429430 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429407    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-envoy\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.429649 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429450    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istiod-ca-cert\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.429649 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429490    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-certs\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.429649 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429514    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v2pq\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-kube-api-access-8v2pq\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.429649 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429546    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-credential-socket\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.429649 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429574    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-data\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.429649 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429602    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-token\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.429989 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429818    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:21.429989 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-socket\") pod \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\" (UID: \"01a71e7b-c73c-4c9c-a810-fce3e641ab08\") "
Jul 03 10:12:21.430097 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.429999    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:12:21.430154 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.430094    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:21.430337 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.430304    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:21.430481 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.430362    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istiod-ca-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.430481 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.430392    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.430481 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.430406    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-credential-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.430648 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.430602    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-data" (OuterVolumeSpecName: "istio-data") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:21.432003 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.431978    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-kube-api-access-8v2pq" (OuterVolumeSpecName: "kube-api-access-8v2pq") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "kube-api-access-8v2pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:12:21.432003 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.431987    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:21.432166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.432094    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:12:21.432166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.432116    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-token" (OuterVolumeSpecName: "istio-token") pod "01a71e7b-c73c-4c9c-a810-fce3e641ab08" (UID: "01a71e7b-c73c-4c9c-a810-fce3e641ab08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:12:21.531014 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.530975    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-podinfo\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.531014 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.531005    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-envoy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.531014 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.531015    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v2pq\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-kube-api-access-8v2pq\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.531232 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.531026    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-data\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.531232 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.531036    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01a71e7b-c73c-4c9c-a810-fce3e641ab08-istio-token\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.531232 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.531044    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01a71e7b-c73c-4c9c-a810-fce3e641ab08-workload-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:21.994553 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.994517    2580 generic.go:356] "Generic (PLEG): container finished" podID="01a71e7b-c73c-4c9c-a810-fce3e641ab08" containerID="3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2" exitCode=0
Jul 03 10:12:21.994720 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.994569    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"
Jul 03 10:12:21.994720 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.994587    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr" event={"ID":"01a71e7b-c73c-4c9c-a810-fce3e641ab08","Type":"ContainerDied","Data":"3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2"}
Jul 03 10:12:21.994720 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.994641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr" event={"ID":"01a71e7b-c73c-4c9c-a810-fce3e641ab08","Type":"ContainerDied","Data":"35e26d27c1040f880256c0f9f0e95c767e379c36cb11425464cec7fc05bcf3ee"}
Jul 03 10:12:21.994720 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:21.994672    2580 scope.go:117] "RemoveContainer" containerID="3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2"
Jul 03 10:12:22.003842 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.003822    2580 scope.go:117] "RemoveContainer" containerID="3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2"
Jul 03 10:12:22.004134 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:12:22.004099    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2\": container with ID starting with 3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2 not found: ID does not exist" containerID="3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2"
Jul 03 10:12:22.004265 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.004138    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2"} err="failed to get container status \"3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2\": rpc error: code = NotFound desc = could not find container \"3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2\": container with ID starting with 3fabb6364ea4c236ddd49bca906f7945d82be37e883de2c985b31d274da82ef2 not found: ID does not exist"
Jul 03 10:12:22.021720 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.021692    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"]
Jul 03 10:12:22.026233 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.026206    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-375f3f4c-openshift-default-858db8847c-5n7gr"]
Jul 03 10:12:22.291066 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.291033    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a71e7b-c73c-4c9c-a810-fce3e641ab08" path="/var/lib/kubelet/pods/01a71e7b-c73c-4c9c-a810-fce3e641ab08/volumes"
Jul 03 10:12:22.505000 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.504965    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"]
Jul 03 10:12:22.505462 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.505444    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a71e7b-c73c-4c9c-a810-fce3e641ab08" containerName="istio-proxy"
Jul 03 10:12:22.505511 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.505467    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a71e7b-c73c-4c9c-a810-fce3e641ab08" containerName="istio-proxy"
Jul 03 10:12:22.505587 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.505572    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01a71e7b-c73c-4c9c-a810-fce3e641ab08" containerName="istio-proxy"
Jul 03 10:12:22.508759 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.508721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.511984 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.511964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dc22bc5f-openshift-default-dockercfg-5wrtn\""
Jul 03 10:12:22.539426 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.539393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"]
Jul 03 10:12:22.639774 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.639680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8fxq\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-kube-api-access-c8fxq\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.639774 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.639721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-envoy\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.639948 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.639786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-podinfo\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.639948 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.639841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-credential-socket\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.639948 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.639879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-token\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.639948 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.639911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-data\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.640077 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.639973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-certs\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.640077 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.640010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-socket\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.640077 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.640047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0434db48-6703-4d16-a2ea-2cc995d09eab-istiod-ca-cert\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741020 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.740991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0434db48-6703-4d16-a2ea-2cc995d09eab-istiod-ca-cert\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741178 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8fxq\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-kube-api-access-c8fxq\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741178 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-envoy\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741178 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-podinfo\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741178 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-credential-socket\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741355 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-token\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741355 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-data\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741498 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-certs\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741498 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-socket\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741873 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741525    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-credential-socket\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741873 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741651    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-data\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741873 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741793    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-socket\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.741873 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741849    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-certs\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.742167 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.741979    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0434db48-6703-4d16-a2ea-2cc995d09eab-istiod-ca-cert\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.743496 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.743472    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-envoy\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.743606 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.743591    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-podinfo\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.749802 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.749781    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8fxq\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-kube-api-access-c8fxq\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.750187 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.750163    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-token\") pod \"e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") " pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.819421 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.819389    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:22.950035 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.950006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"]
Jul 03 10:12:22.952145 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:12:22.952120    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0434db48_6703_4d16_a2ea_2cc995d09eab.slice/crio-e46b2b90795a9390c952377c1161485c916780028c2ec8cd70980fc18f3f80bf WatchSource:0}: Error finding container e46b2b90795a9390c952377c1161485c916780028c2ec8cd70980fc18f3f80bf: Status 404 returned error can't find the container with id e46b2b90795a9390c952377c1161485c916780028c2ec8cd70980fc18f3f80bf
Jul 03 10:12:22.954308 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.954277    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:22.954425 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.954348    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:22.954425 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:22.954401    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:23.001678 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:23.001653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" event={"ID":"0434db48-6703-4d16-a2ea-2cc995d09eab","Type":"ContainerStarted","Data":"e46b2b90795a9390c952377c1161485c916780028c2ec8cd70980fc18f3f80bf"}
Jul 03 10:12:24.008235 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:24.008204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" event={"ID":"0434db48-6703-4d16-a2ea-2cc995d09eab","Type":"ContainerStarted","Data":"3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece"}
Jul 03 10:12:24.041078 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:24.041031    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" podStartSLOduration=2.041012716 podStartE2EDuration="2.041012716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:12:24.038125484 +0000 UTC m=+1748.206600886" watchObservedRunningTime="2026-07-03 10:12:24.041012716 +0000 UTC m=+1748.209488117"
Jul 03 10:12:24.819803 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:24.819766    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:24.824445 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:24.824417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:25.013698 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:25.013666    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:25.014593 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:25.014573    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:35.078272 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:35.078241    2580 generic.go:356] "Generic (PLEG): container finished" podID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerID="3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece" exitCode=0
Jul 03 10:12:35.078697 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:35.078282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" event={"ID":"0434db48-6703-4d16-a2ea-2cc995d09eab","Type":"ContainerDied","Data":"3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece"}
Jul 03 10:12:35.078697 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:35.078645    2580 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" secret="" err="secret \"e2e-ait-dc22bc5f-openshift-default-dockercfg-5wrtn\" not found"
Jul 03 10:12:35.078794 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:35.078701    2580 scope.go:117] "RemoveContainer" containerID="3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece"
Jul 03 10:12:35.079855 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:35.079826    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:35.079919 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:35.079897    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:35.079955 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:35.079932    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:12:35.097676 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:35.097652    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"]
Jul 03 10:12:36.084795 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:36.084757    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" event={"ID":"0434db48-6703-4d16-a2ea-2cc995d09eab","Type":"ContainerStarted","Data":"a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b"}
Jul 03 10:12:36.085257 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:36.084853    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" podUID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerName="istio-proxy" containerID="cri-o://a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b" gracePeriod=30
Jul 03 10:12:40.013756 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:40.013696    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:41.330198 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.330171    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:41.505896 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.505819    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-token\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.505896 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.505853    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-credential-socket\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.505896 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.505876    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-data\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.506181 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.505906    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0434db48-6703-4d16-a2ea-2cc995d09eab-istiod-ca-cert\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.506181 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.505940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8fxq\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-kube-api-access-c8fxq\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.506181 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.505972    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-envoy\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.506181 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.505999    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-socket\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.506181 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.506063    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-podinfo\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.506181 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.506087    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-certs\") pod \"0434db48-6703-4d16-a2ea-2cc995d09eab\" (UID: \"0434db48-6703-4d16-a2ea-2cc995d09eab\") "
Jul 03 10:12:41.506492 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.506200    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:41.506492 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.506352    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-credential-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:41.506492 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.506417    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:41.506492 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.506444    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:41.506492 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.506372    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0434db48-6703-4d16-a2ea-2cc995d09eab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:12:41.506912 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.506889    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-data" (OuterVolumeSpecName: "istio-data") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:41.508226 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.508204    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-kube-api-access-c8fxq" (OuterVolumeSpecName: "kube-api-access-c8fxq") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "kube-api-access-c8fxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:12:41.508506 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.508483    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:12:41.508758 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.508726    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:41.508828 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.508761    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-token" (OuterVolumeSpecName: "istio-token") pod "0434db48-6703-4d16-a2ea-2cc995d09eab" (UID: "0434db48-6703-4d16-a2ea-2cc995d09eab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:12:41.607649 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.607630    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-podinfo\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:41.607649 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.607649    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:41.607822 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.607658    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-token\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:41.607822 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.607665    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-data\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:41.607822 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.607673    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0434db48-6703-4d16-a2ea-2cc995d09eab-istiod-ca-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:41.607822 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.607680    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8fxq\" (UniqueName: \"kubernetes.io/projected/0434db48-6703-4d16-a2ea-2cc995d09eab-kube-api-access-c8fxq\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:41.607822 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.607690    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-istio-envoy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:41.607822 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:41.607698    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0434db48-6703-4d16-a2ea-2cc995d09eab-workload-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:12:42.120130 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.120099    2580 generic.go:356] "Generic (PLEG): container finished" podID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerID="a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b" exitCode=0
Jul 03 10:12:42.120326 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.120153    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"
Jul 03 10:12:42.120326 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.120180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" event={"ID":"0434db48-6703-4d16-a2ea-2cc995d09eab","Type":"ContainerDied","Data":"a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b"}
Jul 03 10:12:42.120326 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.120236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb" event={"ID":"0434db48-6703-4d16-a2ea-2cc995d09eab","Type":"ContainerDied","Data":"e46b2b90795a9390c952377c1161485c916780028c2ec8cd70980fc18f3f80bf"}
Jul 03 10:12:42.120326 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.120258    2580 scope.go:117] "RemoveContainer" containerID="a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b"
Jul 03 10:12:42.129774 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.129759    2580 scope.go:117] "RemoveContainer" containerID="3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece"
Jul 03 10:12:42.137636 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.137613    2580 scope.go:117] "RemoveContainer" containerID="a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b"
Jul 03 10:12:42.137880 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:12:42.137864    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b\": container with ID starting with a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b not found: ID does not exist" containerID="a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b"
Jul 03 10:12:42.137944 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.137887    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b"} err="failed to get container status \"a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b\": rpc error: code = NotFound desc = could not find container \"a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b\": container with ID starting with a14ace7477a504a19985ca7c3fb5771dad0fec0558c80286c96040843b054d7b not found: ID does not exist"
Jul 03 10:12:42.137944 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.137901    2580 scope.go:117] "RemoveContainer" containerID="3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece"
Jul 03 10:12:42.138095 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:12:42.138076    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece\": container with ID starting with 3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece not found: ID does not exist" containerID="3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece"
Jul 03 10:12:42.138135 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.138102    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece"} err="failed to get container status \"3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece\": rpc error: code = NotFound desc = could not find container \"3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece\": container with ID starting with 3a8872227aad2bcc0caadcd825ef1961bcb2b0a2ab7cbd131f76195f66ba3ece not found: ID does not exist"
Jul 03 10:12:42.146173 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.146143    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"]
Jul 03 10:12:42.156381 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.156362    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dc22bc5f-openshift-default-77c49d794f-hxpgb"]
Jul 03 10:12:42.289371 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:12:42.289338    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0434db48-6703-4d16-a2ea-2cc995d09eab" path="/var/lib/kubelet/pods/0434db48-6703-4d16-a2ea-2cc995d09eab/volumes"
Jul 03 10:14:31.047303 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.047260    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"]
Jul 03 10:14:31.047934 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.047758    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerName="istio-proxy"
Jul 03 10:14:31.047934 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.047778    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerName="istio-proxy"
Jul 03 10:14:31.047934 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.047790    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerName="istio-proxy"
Jul 03 10:14:31.047934 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.047799    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerName="istio-proxy"
Jul 03 10:14:31.047934 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.047911    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerName="istio-proxy"
Jul 03 10:14:31.050615 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.050594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.053944 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.053924    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ae3a9533-openshift-default-dockercfg-l8mk7\""
Jul 03 10:14:31.083376 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.083347    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"]
Jul 03 10:14:31.229595 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-socket\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.229785 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-data\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.229785 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab628038-6f13-4185-bc03-c5ec0912f734-istiod-ca-cert\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.229785 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-envoy\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.229785 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab628038-6f13-4185-bc03-c5ec0912f734-istio-podinfo\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.229937 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-istio-token\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.229937 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229829    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-certs\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.229937 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txr7g\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-kube-api-access-txr7g\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.229937 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.229898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-credential-socket\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331125 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-credential-socket\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331125 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-socket\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331345 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-data\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331345 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab628038-6f13-4185-bc03-c5ec0912f734-istiod-ca-cert\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331345 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-envoy\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331345 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab628038-6f13-4185-bc03-c5ec0912f734-istio-podinfo\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-istio-token\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-certs\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txr7g\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-kube-api-access-txr7g\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331420    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-socket\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331462    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-credential-socket\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331547    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-data\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331890 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331770    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-certs\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.331997 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.331981    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab628038-6f13-4185-bc03-c5ec0912f734-istiod-ca-cert\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.333702 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.333679    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-envoy\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.333916 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.333891    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab628038-6f13-4185-bc03-c5ec0912f734-istio-podinfo\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.342350 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.342331    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-istio-token\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.343887 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.343868    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txr7g\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-kube-api-access-txr7g\") pod \"e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") " pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.361607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.361583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:31.508431 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.508312    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"]
Jul 03 10:14:31.511498 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:14:31.511464    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab628038_6f13_4185_bc03_c5ec0912f734.slice/crio-df0d85bc0ecb8c38d512479dc3cc7dd75c4f690b76b465f70acb822e69e0abbe WatchSource:0}: Error finding container df0d85bc0ecb8c38d512479dc3cc7dd75c4f690b76b465f70acb822e69e0abbe: Status 404 returned error can't find the container with id df0d85bc0ecb8c38d512479dc3cc7dd75c4f690b76b465f70acb822e69e0abbe
Jul 03 10:14:31.513533 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.513502    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:14:31.513603 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.513572    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:14:31.513639 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.513604    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:14:31.643463 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.643371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" event={"ID":"ab628038-6f13-4185-bc03-c5ec0912f734","Type":"ContainerStarted","Data":"ee2a1c9a904325628eae108035a4790115be94a70c8b4024d03af30c5bf21a2c"}
Jul 03 10:14:31.643463 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.643444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" event={"ID":"ab628038-6f13-4185-bc03-c5ec0912f734","Type":"ContainerStarted","Data":"df0d85bc0ecb8c38d512479dc3cc7dd75c4f690b76b465f70acb822e69e0abbe"}
Jul 03 10:14:31.670651 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:31.670596    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" podStartSLOduration=0.670537727 podStartE2EDuration="670.537727ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:14:31.670321756 +0000 UTC m=+1875.838797160" watchObservedRunningTime="2026-07-03 10:14:31.670537727 +0000 UTC m=+1875.839013129"
Jul 03 10:14:32.361930 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:32.361899    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:32.366595 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:32.366571    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:32.648148 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:32.648055    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:32.648865 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:32.648848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:47.808795 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:47.808761    2580 patch_prober.go:28] interesting pod/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": read tcp 10.132.0.2:51110->10.132.0.39:15021: read: connection reset by peer" start-of-body=
Jul 03 10:14:47.809215 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:47.808848    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": read tcp 10.132.0.2:51110->10.132.0.39:15021: read: connection reset by peer"
Jul 03 10:14:48.729763 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:48.729719    2580 generic.go:356] "Generic (PLEG): container finished" podID="ab628038-6f13-4185-bc03-c5ec0912f734" containerID="ee2a1c9a904325628eae108035a4790115be94a70c8b4024d03af30c5bf21a2c" exitCode=0
Jul 03 10:14:48.729932 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:48.729795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" event={"ID":"ab628038-6f13-4185-bc03-c5ec0912f734","Type":"ContainerDied","Data":"ee2a1c9a904325628eae108035a4790115be94a70c8b4024d03af30c5bf21a2c"}
Jul 03 10:14:48.730191 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:48.730178    2580 scope.go:117] "RemoveContainer" containerID="ee2a1c9a904325628eae108035a4790115be94a70c8b4024d03af30c5bf21a2c"
Jul 03 10:14:48.731168 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:48.731143    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:14:48.731229 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:48.731207    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:14:48.731264 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:48.731248    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:14:49.739794 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:49.739755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" event={"ID":"ab628038-6f13-4185-bc03-c5ec0912f734","Type":"ContainerStarted","Data":"565643b0a229651cd0f4ddbe2d9afd99c626d286396f64bd8b39d9094d99a261"}
Jul 03 10:14:50.362494 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:50.362459    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:50.362798 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:50.362774    2580 patch_prober.go:28] interesting pod/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 03 10:14:50.362861 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:50.362823    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 03 10:14:51.362072 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:51.362039    2580 patch_prober.go:28] interesting pod/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 03 10:14:51.362462 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:51.362090    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 03 10:14:52.362792 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:52.362755    2580 patch_prober.go:28] interesting pod/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 03 10:14:52.363187 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:52.362810    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 03 10:14:52.457669 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:52.457627    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"]
Jul 03 10:14:52.457909 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:52.457879    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy" containerID="cri-o://565643b0a229651cd0f4ddbe2d9afd99c626d286396f64bd8b39d9094d99a261" gracePeriod=30
Jul 03 10:14:58.794084 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.794052    2580 generic.go:356] "Generic (PLEG): container finished" podID="ab628038-6f13-4185-bc03-c5ec0912f734" containerID="565643b0a229651cd0f4ddbe2d9afd99c626d286396f64bd8b39d9094d99a261" exitCode=0
Jul 03 10:14:58.794411 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.794096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" event={"ID":"ab628038-6f13-4185-bc03-c5ec0912f734","Type":"ContainerDied","Data":"565643b0a229651cd0f4ddbe2d9afd99c626d286396f64bd8b39d9094d99a261"}
Jul 03 10:14:58.794411 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.794151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz" event={"ID":"ab628038-6f13-4185-bc03-c5ec0912f734","Type":"ContainerDied","Data":"df0d85bc0ecb8c38d512479dc3cc7dd75c4f690b76b465f70acb822e69e0abbe"}
Jul 03 10:14:58.794411 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.794177    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df0d85bc0ecb8c38d512479dc3cc7dd75c4f690b76b465f70acb822e69e0abbe"
Jul 03 10:14:58.794411 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.794194    2580 scope.go:117] "RemoveContainer" containerID="ee2a1c9a904325628eae108035a4790115be94a70c8b4024d03af30c5bf21a2c"
Jul 03 10:14:58.806838 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.806817    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:58.874076 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874042    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab628038-6f13-4185-bc03-c5ec0912f734-istiod-ca-cert\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874259 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-envoy\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874259 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-data\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874259 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874127    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-certs\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874424 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874261    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-credential-socket\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874424 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874329    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab628038-6f13-4185-bc03-c5ec0912f734-istio-podinfo\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874424 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874394    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-istio-token\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874424 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874391    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:14:58.874647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874427    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-socket\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874463    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txr7g\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-kube-api-access-txr7g\") pod \"ab628038-6f13-4185-bc03-c5ec0912f734\" (UID: \"ab628038-6f13-4185-bc03-c5ec0912f734\") "
Jul 03 10:14:58.874647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874561    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:14:58.874647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874583    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab628038-6f13-4185-bc03-c5ec0912f734-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:14:58.874869 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874804    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:14:58.874921 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874891    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab628038-6f13-4185-bc03-c5ec0912f734-istiod-ca-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:58.874921 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874913    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:58.875010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874926    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-credential-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:58.875010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874941    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-workload-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:58.875010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.874990    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:14:58.876744 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.876710    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:14:58.876904 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.876874    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-kube-api-access-txr7g" (OuterVolumeSpecName: "kube-api-access-txr7g") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "kube-api-access-txr7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:14:58.877004 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.876904    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:14:58.877004 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.876919    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab628038-6f13-4185-bc03-c5ec0912f734-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab628038-6f13-4185-bc03-c5ec0912f734" (UID: "ab628038-6f13-4185-bc03-c5ec0912f734"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:14:58.975554 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.975486    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab628038-6f13-4185-bc03-c5ec0912f734-istio-podinfo\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:58.975554 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.975511    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-istio-token\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:58.975554 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.975521    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txr7g\" (UniqueName: \"kubernetes.io/projected/ab628038-6f13-4185-bc03-c5ec0912f734-kube-api-access-txr7g\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:58.975554 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.975530    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-envoy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:58.975554 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:58.975538    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab628038-6f13-4185-bc03-c5ec0912f734-istio-data\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:14:59.800780 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:59.800754    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"
Jul 03 10:14:59.834157 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:59.834124    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"]
Jul 03 10:14:59.838574 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:14:59.838552    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ae3a9533-openshift-default-7b4d994d5f-kwkqz"]
Jul 03 10:15:00.290678 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:00.290645    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" path="/var/lib/kubelet/pods/ab628038-6f13-4185-bc03-c5ec0912f734/volumes"
Jul 03 10:15:11.901443 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.901405    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"]
Jul 03 10:15:11.902005 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.901750    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy"
Jul 03 10:15:11.902005 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.901764    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy"
Jul 03 10:15:11.902005 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.901841    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0434db48-6703-4d16-a2ea-2cc995d09eab" containerName="istio-proxy"
Jul 03 10:15:11.902005 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.901850    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy"
Jul 03 10:15:11.905908 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.905887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.908645 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.908628    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d191a33c-openshift-default-dockercfg-dtdtq\""
Jul 03 10:15:11.925618 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.925596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"]
Jul 03 10:15:11.985580 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-envoy\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.985772 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-credential-socket\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.985772 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985666    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-data\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.985772 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-socket\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.985772 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985752    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3124067a-53a5-431d-9772-d763c75e9d30-istiod-ca-cert\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.986019 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-istio-token\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.986019 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985817    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-certs\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.986019 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-kube-api-access-4mkqs\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:11.986019 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:11.985895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3124067a-53a5-431d-9772-d763c75e9d30-istio-podinfo\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.086981 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.086950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3124067a-53a5-431d-9772-d763c75e9d30-istiod-ca-cert\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087158 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.086996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-istio-token\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087158 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-certs\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087158 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-kube-api-access-4mkqs\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087158 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3124067a-53a5-431d-9772-d763c75e9d30-istio-podinfo\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087158 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-envoy\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087158 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-credential-socket\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087446 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-data\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087446 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-socket\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.087884 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087528    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-certs\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.088006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087881    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3124067a-53a5-431d-9772-d763c75e9d30-istiod-ca-cert\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.088006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087556    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-credential-socket\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.088006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087663    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-socket\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.088006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.087783    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-data\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.089364 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.089335    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-envoy\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.089645 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.089624    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3124067a-53a5-431d-9772-d763c75e9d30-istio-podinfo\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.103129 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.103102    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-istio-token\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.103242 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.103170    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-kube-api-access-4mkqs\") pod \"e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") " pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.215858 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.215767    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:12.348704 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.348682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"]
Jul 03 10:15:12.350530 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:15:12.350506    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3124067a_53a5_431d_9772_d763c75e9d30.slice/crio-d2d066359a4e0e6786e6bfa8b94d7abf515e302f44a1f97461134da00fe45b79 WatchSource:0}: Error finding container d2d066359a4e0e6786e6bfa8b94d7abf515e302f44a1f97461134da00fe45b79: Status 404 returned error can't find the container with id d2d066359a4e0e6786e6bfa8b94d7abf515e302f44a1f97461134da00fe45b79
Jul 03 10:15:12.352659 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.352631    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:15:12.352723 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.352691    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:15:12.352723 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.352719    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:15:12.863688 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.863656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" event={"ID":"3124067a-53a5-431d-9772-d763c75e9d30","Type":"ContainerStarted","Data":"73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0"}
Jul 03 10:15:12.863913 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.863709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" event={"ID":"3124067a-53a5-431d-9772-d763c75e9d30","Type":"ContainerStarted","Data":"d2d066359a4e0e6786e6bfa8b94d7abf515e302f44a1f97461134da00fe45b79"}
Jul 03 10:15:12.884453 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:12.884387    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" podStartSLOduration=1.88436962 podStartE2EDuration="1.88436962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:15:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:15:12.88308241 +0000 UTC m=+1917.051557811" watchObservedRunningTime="2026-07-03 10:15:12.88436962 +0000 UTC m=+1917.052845022"
Jul 03 10:15:13.216698 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:13.216616    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:13.220864 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:13.220839    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:13.869147 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:13.869115    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:13.870009 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:13.869991    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:29.022101 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:29.021422    2580 patch_prober.go:28] interesting pod/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:36944->10.132.0.40:15021: read: connection reset by peer" start-of-body=
Jul 03 10:15:29.022101 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:29.021516    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:36944->10.132.0.40:15021: read: connection reset by peer"
Jul 03 10:15:29.951028 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:29.950995    2580 generic.go:356] "Generic (PLEG): container finished" podID="3124067a-53a5-431d-9772-d763c75e9d30" containerID="73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0" exitCode=0
Jul 03 10:15:29.951219 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:29.951058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" event={"ID":"3124067a-53a5-431d-9772-d763c75e9d30","Type":"ContainerDied","Data":"73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0"}
Jul 03 10:15:29.951467 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:29.951449    2580 scope.go:117] "RemoveContainer" containerID="73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0"
Jul 03 10:15:29.952430 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:29.952401    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:15:29.952522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:29.952487    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:15:29.952591 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:29.952535    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:15:30.960460 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:30.960428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" event={"ID":"3124067a-53a5-431d-9772-d763c75e9d30","Type":"ContainerStarted","Data":"5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9"}
Jul 03 10:15:31.216722 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:31.216632    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:31.216889 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:31.216821    2580 patch_prober.go:28] interesting pod/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 03 10:15:31.216889 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:31.216875    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 03 10:15:32.217017 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:32.216979    2580 patch_prober.go:28] interesting pod/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 03 10:15:32.217414 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:32.217034    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 03 10:15:33.216459 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:33.216420    2580 patch_prober.go:28] interesting pod/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 03 10:15:33.216662 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:33.216478    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 03 10:15:34.216657 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:34.216623    2580 patch_prober.go:28] interesting pod/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 03 10:15:34.217095 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:34.216674    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 03 10:15:35.219672 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:35.219643    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:35.220094 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:35.219912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:15:35.220635 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:15:35.220620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:17:07.703470 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:07.703430    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"]
Jul 03 10:17:07.704002 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:07.703705    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy" containerID="cri-o://5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9" gracePeriod=30
Jul 03 10:17:12.963619 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:12.963594    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:17:13.026077 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026046    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-credential-socket\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026077 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026079    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3124067a-53a5-431d-9772-d763c75e9d30-istiod-ca-cert\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026338 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026117    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-kube-api-access-4mkqs\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026338 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-certs\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026338 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026278    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-data\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026338 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026319    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-envoy\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026338 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026336    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-socket\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026385    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-istio-token\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026427    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3124067a-53a5-431d-9772-d763c75e9d30-istio-podinfo\") pod \"3124067a-53a5-431d-9772-d763c75e9d30\" (UID: \"3124067a-53a5-431d-9772-d763c75e9d30\") "
Jul 03 10:17:13.026607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026431    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:17:13.026607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026433    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:17:13.026852 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026639    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3124067a-53a5-431d-9772-d763c75e9d30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:17:13.026852 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026713    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:17:13.026953 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026935    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.027010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026955    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-credential-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.027010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026972    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3124067a-53a5-431d-9772-d763c75e9d30-istiod-ca-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.027010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.026987    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-workload-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.027236 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.027207    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-data" (OuterVolumeSpecName: "istio-data") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:17:13.028444 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.028411    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:17:13.028570 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.028545    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-istio-token" (OuterVolumeSpecName: "istio-token") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:17:13.028808 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.028787    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-kube-api-access-4mkqs" (OuterVolumeSpecName: "kube-api-access-4mkqs") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "kube-api-access-4mkqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:17:13.028917 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.028825    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3124067a-53a5-431d-9772-d763c75e9d30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3124067a-53a5-431d-9772-d763c75e9d30" (UID: "3124067a-53a5-431d-9772-d763c75e9d30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:17:13.127607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.127557    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mkqs\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-kube-api-access-4mkqs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.127607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.127601    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-data\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.127607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.127610    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3124067a-53a5-431d-9772-d763c75e9d30-istio-envoy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.127607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.127618    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3124067a-53a5-431d-9772-d763c75e9d30-istio-token\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.127607 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.127626    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3124067a-53a5-431d-9772-d763c75e9d30-istio-podinfo\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:17:13.472783 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.472674    2580 generic.go:356] "Generic (PLEG): container finished" podID="3124067a-53a5-431d-9772-d763c75e9d30" containerID="5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9" exitCode=0
Jul 03 10:17:13.472783 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.472727    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"
Jul 03 10:17:13.472783 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.472762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" event={"ID":"3124067a-53a5-431d-9772-d763c75e9d30","Type":"ContainerDied","Data":"5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9"}
Jul 03 10:17:13.473013 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.472817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z" event={"ID":"3124067a-53a5-431d-9772-d763c75e9d30","Type":"ContainerDied","Data":"d2d066359a4e0e6786e6bfa8b94d7abf515e302f44a1f97461134da00fe45b79"}
Jul 03 10:17:13.473013 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.472841    2580 scope.go:117] "RemoveContainer" containerID="5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9"
Jul 03 10:17:13.482412 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.482394    2580 scope.go:117] "RemoveContainer" containerID="73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0"
Jul 03 10:17:13.490161 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.490141    2580 scope.go:117] "RemoveContainer" containerID="5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9"
Jul 03 10:17:13.490414 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:17:13.490393    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9\": container with ID starting with 5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9 not found: ID does not exist" containerID="5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9"
Jul 03 10:17:13.490464 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.490423    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9"} err="failed to get container status \"5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9\": rpc error: code = NotFound desc = could not find container \"5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9\": container with ID starting with 5ef41fa133ebfb55bcd3de9e87bfbc95306cf7263dc8aa34f6e19db27ab00bf9 not found: ID does not exist"
Jul 03 10:17:13.490464 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.490441    2580 scope.go:117] "RemoveContainer" containerID="73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0"
Jul 03 10:17:13.490668 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:17:13.490649    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0\": container with ID starting with 73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0 not found: ID does not exist" containerID="73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0"
Jul 03 10:17:13.490742 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.490678    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0"} err="failed to get container status \"73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0\": rpc error: code = NotFound desc = could not find container \"73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0\": container with ID starting with 73f75bfdeb6af7f26914c413fabc911a07af849490fe6ea7eb8548df4093d7e0 not found: ID does not exist"
Jul 03 10:17:13.500341 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.500314    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"]
Jul 03 10:17:13.514240 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:13.514209    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d191a33c-openshift-default-744cfd9b9f-kg29z"]
Jul 03 10:17:14.290078 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:17:14.290040    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3124067a-53a5-431d-9772-d763c75e9d30" path="/var/lib/kubelet/pods/3124067a-53a5-431d-9772-d763c75e9d30/volumes"
Jul 03 10:18:05.807033 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.807002    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"]
Jul 03 10:18:05.807522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.807314    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy"
Jul 03 10:18:05.807522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.807325    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy"
Jul 03 10:18:05.807522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.807347    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy"
Jul 03 10:18:05.807522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.807353    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy"
Jul 03 10:18:05.807522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.807404    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy"
Jul 03 10:18:05.807522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.807413    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy"
Jul 03 10:18:05.807522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.807419    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab628038-6f13-4185-bc03-c5ec0912f734" containerName="istio-proxy"
Jul 03 10:18:05.810311 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.810295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:05.813156 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.813109    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-90e0ea-serving-cert\""
Jul 03 10:18:05.813344 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.813330    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bh87n\""
Jul 03 10:18:05.828684 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.828663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"]
Jul 03 10:18:05.871568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.871537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:05.871719 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.871592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:05.871719 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.871616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzzgg\" (UniqueName: \"kubernetes.io/projected/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-kube-api-access-pzzgg\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:05.973067 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.973033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:05.973234 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.973074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzzgg\" (UniqueName: \"kubernetes.io/projected/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-kube-api-access-pzzgg\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:05.973234 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.973121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:05.973234 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:18:05.973228    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-90e0ea-serving-cert: secret "maas-api-e2e-inf-a-90e0ea-serving-cert" not found
Jul 03 10:18:05.973341 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:18:05.973286    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls podName:a55f4ad9-d1ec-4093-a410-ceef1e5965c8 nodeName:}" failed. No retries permitted until 2026-07-03 10:18:06.473269344 +0000 UTC m=+2090.641744724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls") pod "maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv" (UID: "a55f4ad9-d1ec-4093-a410-ceef1e5965c8") : secret "maas-api-e2e-inf-a-90e0ea-serving-cert" not found
Jul 03 10:18:05.973677 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.973656    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:05.985375 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:05.985344    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzzgg\" (UniqueName: \"kubernetes.io/projected/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-kube-api-access-pzzgg\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:06.478074 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:06.478042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:06.480489 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:06.480471    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls\") pod \"maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") " pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:06.720661 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:06.720630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:06.860453 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:06.860424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"]
Jul 03 10:18:06.861685 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:18:06.861657    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55f4ad9_d1ec_4093_a410_ceef1e5965c8.slice/crio-715bc7251945a95bec8fe76744e50e7038ecc502305150491cb922cdda0bc9a8 WatchSource:0}: Error finding container 715bc7251945a95bec8fe76744e50e7038ecc502305150491cb922cdda0bc9a8: Status 404 returned error can't find the container with id 715bc7251945a95bec8fe76744e50e7038ecc502305150491cb922cdda0bc9a8
Jul 03 10:18:06.863112 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:06.863095    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 10:18:07.744559 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:07.744515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv" event={"ID":"a55f4ad9-d1ec-4093-a410-ceef1e5965c8","Type":"ContainerStarted","Data":"715bc7251945a95bec8fe76744e50e7038ecc502305150491cb922cdda0bc9a8"}
Jul 03 10:18:08.750409 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:08.750307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv" event={"ID":"a55f4ad9-d1ec-4093-a410-ceef1e5965c8","Type":"ContainerStarted","Data":"09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a"}
Jul 03 10:18:08.750791 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:08.750450    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:08.769960 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:08.769919    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv" podStartSLOduration=2.33790663 podStartE2EDuration="3.769904557s" totalImagesPullingTime="1.431997927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:18:08.768119217 +0000 UTC m=+2092.936594620" watchObservedRunningTime="2026-07-03 10:18:08.769904557 +0000 UTC m=+2092.938379959"
Jul 03 10:18:10.830830 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.830796    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"]
Jul 03 10:18:10.831251 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.831236    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy"
Jul 03 10:18:10.831299 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.831253    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3124067a-53a5-431d-9772-d763c75e9d30" containerName="istio-proxy"
Jul 03 10:18:10.834352 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.834332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.837701 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.837681    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0ccbef-openshift-default-dockercfg-lcv72\""
Jul 03 10:18:10.848167 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.848144    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"]
Jul 03 10:18:10.914988 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.914957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-token\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.915188 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.914996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-socket\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.915188 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.915014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrg4\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-kube-api-access-zqrg4\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.915188 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.915080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istiod-ca-cert\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.915188 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.915126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-podinfo\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.915188 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.915172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-envoy\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.915471 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.915224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-data\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.915471 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.915254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-credential-socket\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:10.915471 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:10.915272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-certs\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016365 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-token\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016575 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-socket\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016575 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrg4\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-kube-api-access-zqrg4\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016575 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istiod-ca-cert\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016575 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-podinfo\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016786 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-envoy\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016786 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-data\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016786 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-credential-socket\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016959 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-certs\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.016959 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.016903    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-socket\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.017166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.017144    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-data\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.017241 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.017166    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-certs\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.017241 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.017209    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-credential-socket\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.017358 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.017343    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istiod-ca-cert\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.018957 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.018933    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-envoy\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.019062 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.018956    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-podinfo\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.025525 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.025486    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-token\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.025800 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.025781    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrg4\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-kube-api-access-zqrg4\") pod \"e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") " pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.144060 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.143973    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:11.287999 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.287976    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"]
Jul 03 10:18:11.289413 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:18:11.289391    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7a37a7_f12b_4ef3_8818_51e10e4cd317.slice/crio-e7a454dc3ea5dc831180a8af719f3cc55860dfc5c2729b7289230ddc8da6dcd0 WatchSource:0}: Error finding container e7a454dc3ea5dc831180a8af719f3cc55860dfc5c2729b7289230ddc8da6dcd0: Status 404 returned error can't find the container with id e7a454dc3ea5dc831180a8af719f3cc55860dfc5c2729b7289230ddc8da6dcd0
Jul 03 10:18:11.292001 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.291971    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:18:11.292109 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.292041    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:18:11.292109 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.292082    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:18:11.766885 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.766849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" event={"ID":"ef7a37a7-f12b-4ef3-8818-51e10e4cd317","Type":"ContainerStarted","Data":"8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481"}
Jul 03 10:18:11.767060 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.766908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" event={"ID":"ef7a37a7-f12b-4ef3-8818-51e10e4cd317","Type":"ContainerStarted","Data":"e7a454dc3ea5dc831180a8af719f3cc55860dfc5c2729b7289230ddc8da6dcd0"}
Jul 03 10:18:11.810741 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:11.810691    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" podStartSLOduration=1.810675715 podStartE2EDuration="1.810675715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:18:11.807960552 +0000 UTC m=+2095.976435952" watchObservedRunningTime="2026-07-03 10:18:11.810675715 +0000 UTC m=+2095.979151115"
Jul 03 10:18:12.144529 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:12.144447    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:12.149260 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:12.149234    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:12.772852 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:12.772826    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:12.773826 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:12.773807    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:14.760347 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:14.760322    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:18:26.847321 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:26.847279    2580 generic.go:356] "Generic (PLEG): container finished" podID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerID="8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481" exitCode=0
Jul 03 10:18:26.847854 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:26.847364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" event={"ID":"ef7a37a7-f12b-4ef3-8818-51e10e4cd317","Type":"ContainerDied","Data":"8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481"}
Jul 03 10:18:26.847854 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:26.847850    2580 scope.go:117] "RemoveContainer" containerID="8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481"
Jul 03 10:18:26.848832 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:26.848807    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:18:26.848919 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:26.848883    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:18:26.848919 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:26.848914    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:18:27.773888 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:27.773846    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:27.857790 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:27.857752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" event={"ID":"ef7a37a7-f12b-4ef3-8818-51e10e4cd317","Type":"ContainerStarted","Data":"2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8"}
Jul 03 10:18:28.146400 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:28.145016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:28.147036 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:28.146686    2580 patch_prober.go:28] interesting pod/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 03 10:18:28.147036 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:28.146767    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 03 10:18:29.145053 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:29.145009    2580 patch_prober.go:28] interesting pod/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 03 10:18:29.145563 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:29.145079    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 03 10:18:30.144560 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:30.144515    2580 patch_prober.go:28] interesting pod/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 03 10:18:30.144785 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:30.144586    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 03 10:18:31.144648 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:31.144601    2580 patch_prober.go:28] interesting pod/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 03 10:18:31.145173 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:31.144671    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 03 10:18:32.148046 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:32.148016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:32.148518 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:32.148391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:32.149053 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:32.149035    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:18:42.817978 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.817944    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"]
Jul 03 10:18:42.822518 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.822495    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:42.825020 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.825001    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-90e0ea\"/\"test-model-90e0ea-kserve-self-signed-certs\""
Jul 03 10:18:42.825846 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.825832    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-90e0ea\"/\"openshift-service-ca.crt\""
Jul 03 10:18:42.826009 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.825994    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-90e0ea\"/\"kube-root-ca.crt\""
Jul 03 10:18:42.826078 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.826023    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-90e0ea\"/\"default-dockercfg-fx9mf\""
Jul 03 10:18:42.840422 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.840403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"]
Jul 03 10:18:42.900439 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.900410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tls-certs\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:42.900594 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.900447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-model-cache\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:42.900594 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.900490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j62tn\" (UniqueName: \"kubernetes.io/projected/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-kube-api-access-j62tn\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:42.900594 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.900516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-home\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:42.900594 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.900535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tmp-dir\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:42.900820 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:42.900624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-dshm\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.001464 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.001432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j62tn\" (UniqueName: \"kubernetes.io/projected/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-kube-api-access-j62tn\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.001634 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.001472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-home\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.001634 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.001499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tmp-dir\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.001634 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.001581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-dshm\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.001634 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.001616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tls-certs\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.001898 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.001651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-model-cache\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.002472 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.002441    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tmp-dir\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.002874 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.002672    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-model-cache\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.003274 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.003230    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-home\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.005587 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.005543    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-dshm\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.006372 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.006332    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tls-certs\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.011145 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.011116    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j62tn\" (UniqueName: \"kubernetes.io/projected/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-kube-api-access-j62tn\") pod \"test-model-90e0ea-kserve-b487466b9-bpm72\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") " pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.131922 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.131839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:43.261490 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.261465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"]
Jul 03 10:18:43.263959 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:18:43.263932    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b20f2d2_80a9_4af2_bf4e_c7f3839a8939.slice/crio-94361f1c0157d929d4e6bea7d4cd51abcbde8d9fdf71e50e2341e28eabc1d3fb WatchSource:0}: Error finding container 94361f1c0157d929d4e6bea7d4cd51abcbde8d9fdf71e50e2341e28eabc1d3fb: Status 404 returned error can't find the container with id 94361f1c0157d929d4e6bea7d4cd51abcbde8d9fdf71e50e2341e28eabc1d3fb
Jul 03 10:18:43.940594 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.940560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72" event={"ID":"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939","Type":"ContainerStarted","Data":"ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2"}
Jul 03 10:18:43.940594 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.940599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72" event={"ID":"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939","Type":"ContainerStarted","Data":"94361f1c0157d929d4e6bea7d4cd51abcbde8d9fdf71e50e2341e28eabc1d3fb"}
Jul 03 10:18:43.973524 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:43.973472    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72" podStartSLOduration=1.97345428 podStartE2EDuration="1.97345428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:18:43.971675084 +0000 UTC m=+2128.140150484" watchObservedRunningTime="2026-07-03 10:18:43.97345428 +0000 UTC m=+2128.141929681"
Jul 03 10:18:53.132710 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:53.132671    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:53.133126 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:53.132748    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:53.144989 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:53.144969    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:18:54.008695 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:18:54.008670    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:19:32.343619 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:32.343543    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"]
Jul 03 10:19:34.411047 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.411009    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"]
Jul 03 10:19:34.411513 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.411212    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv" podUID="a55f4ad9-d1ec-4093-a410-ceef1e5965c8" containerName="maas-api" containerID="cri-o://09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a" gracePeriod=30
Jul 03 10:19:34.656593 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.656568    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:19:34.839432 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.839400    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-openshift-service-ca\") pod \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") "
Jul 03 10:19:34.839660 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.839470    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls\") pod \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") "
Jul 03 10:19:34.839660 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.839581    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzzgg\" (UniqueName: \"kubernetes.io/projected/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-kube-api-access-pzzgg\") pod \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\" (UID: \"a55f4ad9-d1ec-4093-a410-ceef1e5965c8\") "
Jul 03 10:19:34.839928 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.839892    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a55f4ad9-d1ec-4093-a410-ceef1e5965c8" (UID: "a55f4ad9-d1ec-4093-a410-ceef1e5965c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:19:34.841594 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.841566    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a55f4ad9-d1ec-4093-a410-ceef1e5965c8" (UID: "a55f4ad9-d1ec-4093-a410-ceef1e5965c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:19:34.841705 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.841676    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-kube-api-access-pzzgg" (OuterVolumeSpecName: "kube-api-access-pzzgg") pod "a55f4ad9-d1ec-4093-a410-ceef1e5965c8" (UID: "a55f4ad9-d1ec-4093-a410-ceef1e5965c8"). InnerVolumeSpecName "kube-api-access-pzzgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:19:34.940870 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.940835    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-maas-api-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:34.940870 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.940864    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzzgg\" (UniqueName: \"kubernetes.io/projected/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-kube-api-access-pzzgg\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:34.940870 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:34.940876    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55f4ad9-d1ec-4093-a410-ceef1e5965c8-openshift-service-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:35.206467 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.206368    2580 generic.go:356] "Generic (PLEG): container finished" podID="a55f4ad9-d1ec-4093-a410-ceef1e5965c8" containerID="09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a" exitCode=0
Jul 03 10:19:35.206467 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.206427    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"
Jul 03 10:19:35.206467 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.206456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv" event={"ID":"a55f4ad9-d1ec-4093-a410-ceef1e5965c8","Type":"ContainerDied","Data":"09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a"}
Jul 03 10:19:35.206759 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.206506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv" event={"ID":"a55f4ad9-d1ec-4093-a410-ceef1e5965c8","Type":"ContainerDied","Data":"715bc7251945a95bec8fe76744e50e7038ecc502305150491cb922cdda0bc9a8"}
Jul 03 10:19:35.206759 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.206526    2580 scope.go:117] "RemoveContainer" containerID="09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a"
Jul 03 10:19:35.218047 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.218023    2580 scope.go:117] "RemoveContainer" containerID="09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a"
Jul 03 10:19:35.218332 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:19:35.218310    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a\": container with ID starting with 09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a not found: ID does not exist" containerID="09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a"
Jul 03 10:19:35.218415 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.218340    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a"} err="failed to get container status \"09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a\": rpc error: code = NotFound desc = could not find container \"09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a\": container with ID starting with 09f43a294adbc4c1e603fe711639652f2d86c2eaed59cbfd51f57170d186eb7a not found: ID does not exist"
Jul 03 10:19:35.231162 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.231132    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"]
Jul 03 10:19:35.235541 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:35.235516    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-90e0ea-d48cb7689-rkftv"]
Jul 03 10:19:36.290839 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:36.290803    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a55f4ad9-d1ec-4093-a410-ceef1e5965c8" path="/var/lib/kubelet/pods/a55f4ad9-d1ec-4093-a410-ceef1e5965c8/volumes"
Jul 03 10:19:47.363215 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.363165    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72" podUID="2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" containerName="main" containerID="cri-o://ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2" gracePeriod=45
Jul 03 10:19:47.614781 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.614711    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:19:47.652481 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652455    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-model-cache\") pod \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") "
Jul 03 10:19:47.652638 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652500    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tls-certs\") pod \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") "
Jul 03 10:19:47.652638 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652538    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j62tn\" (UniqueName: \"kubernetes.io/projected/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-kube-api-access-j62tn\") pod \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") "
Jul 03 10:19:47.652638 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-dshm\") pod \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") "
Jul 03 10:19:47.652638 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652612    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-home\") pod \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") "
Jul 03 10:19:47.652886 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652743    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" (UID: "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:19:47.652886 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652796    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tmp-dir\") pod \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\" (UID: \"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939\") "
Jul 03 10:19:47.653010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652887    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-home" (OuterVolumeSpecName: "home") pod "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" (UID: "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:19:47.653010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.652980    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" (UID: "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:19:47.653167 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.653146    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-model-cache\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:47.653229 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.653173    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-home\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:47.653229 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.653187    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tmp-dir\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:47.654854 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.654819    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" (UID: "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:19:47.655112 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.655092    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-dshm" (OuterVolumeSpecName: "dshm") pod "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" (UID: "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:19:47.655182 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.655107    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-kube-api-access-j62tn" (OuterVolumeSpecName: "kube-api-access-j62tn") pod "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" (UID: "2b20f2d2-80a9-4af2-bf4e-c7f3839a8939"). InnerVolumeSpecName "kube-api-access-j62tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:19:47.754317 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.754286    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-tls-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:47.754317 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.754312    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j62tn\" (UniqueName: \"kubernetes.io/projected/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-kube-api-access-j62tn\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:47.754317 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:47.754324    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939-dshm\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:19:48.275847 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.275814    2580 generic.go:356] "Generic (PLEG): container finished" podID="2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" containerID="ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2" exitCode=0
Jul 03 10:19:48.276035 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.275856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"
Jul 03 10:19:48.276035 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.275912    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72" event={"ID":"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939","Type":"ContainerDied","Data":"ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2"}
Jul 03 10:19:48.276035 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.275956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72" event={"ID":"2b20f2d2-80a9-4af2-bf4e-c7f3839a8939","Type":"ContainerDied","Data":"94361f1c0157d929d4e6bea7d4cd51abcbde8d9fdf71e50e2341e28eabc1d3fb"}
Jul 03 10:19:48.276035 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.275975    2580 scope.go:117] "RemoveContainer" containerID="ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2"
Jul 03 10:19:48.285117 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.285101    2580 scope.go:117] "RemoveContainer" containerID="ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2"
Jul 03 10:19:48.285382 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:19:48.285366    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2\": container with ID starting with ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2 not found: ID does not exist" containerID="ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2"
Jul 03 10:19:48.285439 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.285391    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2"} err="failed to get container status \"ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2\": rpc error: code = NotFound desc = could not find container \"ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2\": container with ID starting with ace748f4704c522ce227d5bdb444be87ce057581369659898ad7f4ff5e7c4ca2 not found: ID does not exist"
Jul 03 10:19:48.302257 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.302233    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"]
Jul 03 10:19:48.312287 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:48.312268    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-90e0ea/test-model-90e0ea-kserve-b487466b9-bpm72"]
Jul 03 10:19:50.288947 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:19:50.288914    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" path="/var/lib/kubelet/pods/2b20f2d2-80a9-4af2-bf4e-c7f3839a8939/volumes"
Jul 03 10:20:24.084397 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:24.084360    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"]
Jul 03 10:20:24.084905 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:24.084601    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy" containerID="cri-o://2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8" gracePeriod=30
Jul 03 10:20:28.407260 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.407225    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"]
Jul 03 10:20:28.407627 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.407533    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a55f4ad9-d1ec-4093-a410-ceef1e5965c8" containerName="maas-api"
Jul 03 10:20:28.407627 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.407544    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a55f4ad9-d1ec-4093-a410-ceef1e5965c8" containerName="maas-api"
Jul 03 10:20:28.407627 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.407569    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" containerName="main"
Jul 03 10:20:28.407627 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.407574    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" containerName="main"
Jul 03 10:20:28.407627 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.407626    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b20f2d2-80a9-4af2-bf4e-c7f3839a8939" containerName="main"
Jul 03 10:20:28.407822 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.407635    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a55f4ad9-d1ec-4093-a410-ceef1e5965c8" containerName="maas-api"
Jul 03 10:20:28.410531 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.410515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:28.412979 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.412956    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-f98768-serving-cert\""
Jul 03 10:20:28.413094 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.412994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bh87n\""
Jul 03 10:20:28.419679 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.419660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"]
Jul 03 10:20:28.505560 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.505524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:28.505717 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.505567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cf37f8-6dec-4631-95fa-eed52fb7795f-openshift-service-ca\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:28.505717 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.505624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q46dh\" (UniqueName: \"kubernetes.io/projected/72cf37f8-6dec-4631-95fa-eed52fb7795f-kube-api-access-q46dh\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:28.606367 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.606324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:28.606582 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.606376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cf37f8-6dec-4631-95fa-eed52fb7795f-openshift-service-ca\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:28.606582 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.606417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q46dh\" (UniqueName: \"kubernetes.io/projected/72cf37f8-6dec-4631-95fa-eed52fb7795f-kube-api-access-q46dh\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:28.606582 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:20:28.606492    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-f98768-serving-cert: secret "maas-api-e2e-api-a-f98768-serving-cert" not found
Jul 03 10:20:28.606582 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:20:28.606581    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls podName:72cf37f8-6dec-4631-95fa-eed52fb7795f nodeName:}" failed. No retries permitted until 2026-07-03 10:20:29.10655955 +0000 UTC m=+2233.275034943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls") pod "maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm" (UID: "72cf37f8-6dec-4631-95fa-eed52fb7795f") : secret "maas-api-e2e-api-a-f98768-serving-cert" not found
Jul 03 10:20:28.607082 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.607053    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cf37f8-6dec-4631-95fa-eed52fb7795f-openshift-service-ca\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:28.615561 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:28.615541    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q46dh\" (UniqueName: \"kubernetes.io/projected/72cf37f8-6dec-4631-95fa-eed52fb7795f-kube-api-access-q46dh\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:29.109956 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.109930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:29.112244 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.112226    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls\") pod \"maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") " pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:29.321286 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.321267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:29.336484 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.336463    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:20:29.413239 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istiod-ca-cert\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.413647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-certs\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.413647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413298    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-token\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.413647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-credential-socket\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.413647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413360    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-socket\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.413647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-envoy\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.413647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413428    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-podinfo\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.413647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413459    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-data\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.413647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413526    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqrg4\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-kube-api-access-zqrg4\") pod \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\" (UID: \"ef7a37a7-f12b-4ef3-8818-51e10e4cd317\") "
Jul 03 10:20:29.414045 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413721    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:20:29.414045 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413780    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:29.414045 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413823    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istiod-ca-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.414045 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.413942    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:29.414262 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.414197    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:29.414592 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.414543    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:29.416612 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.416586    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:20:29.416723 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.416622    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-kube-api-access-zqrg4" (OuterVolumeSpecName: "kube-api-access-zqrg4") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "kube-api-access-zqrg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:20:29.418263 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.418226    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:29.419804 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.419780    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef7a37a7-f12b-4ef3-8818-51e10e4cd317" (UID: "ef7a37a7-f12b-4ef3-8818-51e10e4cd317"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:20:29.488036 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.487995    2580 generic.go:356] "Generic (PLEG): container finished" podID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerID="2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8" exitCode=0
Jul 03 10:20:29.488122 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.488053    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"
Jul 03 10:20:29.488122 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.488063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" event={"ID":"ef7a37a7-f12b-4ef3-8818-51e10e4cd317","Type":"ContainerDied","Data":"2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8"}
Jul 03 10:20:29.488238 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.488124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97" event={"ID":"ef7a37a7-f12b-4ef3-8818-51e10e4cd317","Type":"ContainerDied","Data":"e7a454dc3ea5dc831180a8af719f3cc55860dfc5c2729b7289230ddc8da6dcd0"}
Jul 03 10:20:29.488238 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.488153    2580 scope.go:117] "RemoveContainer" containerID="2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8"
Jul 03 10:20:29.489029 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.489007    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"]
Jul 03 10:20:29.491165 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:20:29.491143    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cf37f8_6dec_4631_95fa_eed52fb7795f.slice/crio-c8ce47c99373e722ea5c8b0f52e43ce220b726d52b6ce944573395a5ce89bbb7 WatchSource:0}: Error finding container c8ce47c99373e722ea5c8b0f52e43ce220b726d52b6ce944573395a5ce89bbb7: Status 404 returned error can't find the container with id c8ce47c99373e722ea5c8b0f52e43ce220b726d52b6ce944573395a5ce89bbb7
Jul 03 10:20:29.497815 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.497797    2580 scope.go:117] "RemoveContainer" containerID="8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481"
Jul 03 10:20:29.505536 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.505520    2580 scope.go:117] "RemoveContainer" containerID="2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8"
Jul 03 10:20:29.505839 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:20:29.505819    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8\": container with ID starting with 2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8 not found: ID does not exist" containerID="2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8"
Jul 03 10:20:29.505920 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.505851    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8"} err="failed to get container status \"2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8\": rpc error: code = NotFound desc = could not find container \"2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8\": container with ID starting with 2d8d749ff384ebc163a73e804e446950fe436baf8a705ae6544d03b6d13d82a8 not found: ID does not exist"
Jul 03 10:20:29.505920 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.505875    2580 scope.go:117] "RemoveContainer" containerID="8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481"
Jul 03 10:20:29.506109 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:20:29.506092    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481\": container with ID starting with 8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481 not found: ID does not exist" containerID="8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481"
Jul 03 10:20:29.506162 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.506117    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481"} err="failed to get container status \"8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481\": rpc error: code = NotFound desc = could not find container \"8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481\": container with ID starting with 8a163597c946ec0600ef5c871f16640e907da2a3a3e72f4fed27d3b653f60481 not found: ID does not exist"
Jul 03 10:20:29.514653 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.514633    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.514653 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.514654    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-token\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.514790 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.514665    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-credential-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.514790 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.514674    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-workload-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.514790 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.514683    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-envoy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.514790 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.514692    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-podinfo\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.514790 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.514699    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-istio-data\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.514790 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.514708    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqrg4\" (UniqueName: \"kubernetes.io/projected/ef7a37a7-f12b-4ef3-8818-51e10e4cd317-kube-api-access-zqrg4\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:29.520088 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.520065    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"]
Jul 03 10:20:29.530570 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:29.530550    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0ccbef-openshift-default-6b8747b9f7-7vd97"]
Jul 03 10:20:30.294084 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:30.294055    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" path="/var/lib/kubelet/pods/ef7a37a7-f12b-4ef3-8818-51e10e4cd317/volumes"
Jul 03 10:20:30.494615 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:30.494562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm" event={"ID":"72cf37f8-6dec-4631-95fa-eed52fb7795f","Type":"ContainerStarted","Data":"924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c"}
Jul 03 10:20:30.495077 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:30.494640    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm" event={"ID":"72cf37f8-6dec-4631-95fa-eed52fb7795f","Type":"ContainerStarted","Data":"c8ce47c99373e722ea5c8b0f52e43ce220b726d52b6ce944573395a5ce89bbb7"}
Jul 03 10:20:30.495077 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:30.494672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:30.514184 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:30.514143    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm" podStartSLOduration=2.014492073 podStartE2EDuration="2.514128352s" totalImagesPullingTime="499.636279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:20:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:20:30.511802119 +0000 UTC m=+2234.680277521" watchObservedRunningTime="2026-07-03 10:20:30.514128352 +0000 UTC m=+2234.682603753"
Jul 03 10:20:33.549704 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.549673    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"]
Jul 03 10:20:33.550079 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.550021    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy"
Jul 03 10:20:33.550079 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.550033    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy"
Jul 03 10:20:33.550079 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.550043    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy"
Jul 03 10:20:33.550079 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.550050    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy"
Jul 03 10:20:33.550207 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.550103    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy"
Jul 03 10:20:33.550207 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.550111    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7a37a7-f12b-4ef3-8818-51e10e4cd317" containerName="istio-proxy"
Jul 03 10:20:33.553299 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.553279    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.555993 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.555967    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4ce0f2-openshift-default-dockercfg-vwq9j\""
Jul 03 10:20:33.566064 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.566042    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"]
Jul 03 10:20:33.647912 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.647882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-token\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.647912 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.647915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istiod-ca-cert\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.648166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.647936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-podinfo\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.648166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.647954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzvqs\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-kube-api-access-qzvqs\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.648166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.648046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-certs\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.648166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.648082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-socket\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.648166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.648108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-data\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.648384 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.648188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-envoy\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.648384 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.648251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-credential-socket\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749232 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzvqs\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-kube-api-access-qzvqs\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749414 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-certs\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749414 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-socket\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749414 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-data\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749414 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-envoy\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749414 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-credential-socket\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749414 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-token\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749414 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istiod-ca-cert\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749860 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-podinfo\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749860 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749682    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-socket\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.749860 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749721    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-data\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.750020 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749892    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-credential-socket\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.750020 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.749939    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-certs\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.750211 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.750188    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istiod-ca-cert\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.751686 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.751663    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-envoy\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.751915 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.751895    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-podinfo\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.758633 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.758599    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzvqs\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-kube-api-access-qzvqs\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.760290 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.760267    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-token\") pod \"e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") " pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.863816 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.863718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:33.996957 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:33.996932    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"]
Jul 03 10:20:33.998837 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:20:33.998815    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccfe53d_2f88_450c_8556_e7e774c7ee42.slice/crio-2596151dd4028b25018e135de154b86e6aff628c3aeeaaf3ad4df11bb145a015 WatchSource:0}: Error finding container 2596151dd4028b25018e135de154b86e6aff628c3aeeaaf3ad4df11bb145a015: Status 404 returned error can't find the container with id 2596151dd4028b25018e135de154b86e6aff628c3aeeaaf3ad4df11bb145a015
Jul 03 10:20:34.000960 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:34.000929    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:20:34.001025 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:34.000998    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:20:34.001067 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:34.001027    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:20:34.519300 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:34.519264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" event={"ID":"9ccfe53d-2f88-450c-8556-e7e774c7ee42","Type":"ContainerStarted","Data":"8bcd821255a1360e59c3f89d1dfd0038446dc873bb08f5ec217e933bc1b70cc8"}
Jul 03 10:20:34.519483 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:34.519320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" event={"ID":"9ccfe53d-2f88-450c-8556-e7e774c7ee42","Type":"ContainerStarted","Data":"2596151dd4028b25018e135de154b86e6aff628c3aeeaaf3ad4df11bb145a015"}
Jul 03 10:20:34.541206 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:34.541162    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" podStartSLOduration=1.541146263 podStartE2EDuration="1.541146263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:20:34.538455569 +0000 UTC m=+2238.706930973" watchObservedRunningTime="2026-07-03 10:20:34.541146263 +0000 UTC m=+2238.709621663"
Jul 03 10:20:34.864034 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:34.863961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:35.868999 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:35.868963    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:36.507705 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.507672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:36.536476 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.536440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:36.537657 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.537632    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:36.720010 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.719976    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"]
Jul 03 10:20:36.723326 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.723305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.726978 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.726957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-4ce0f2-serving-cert\""
Jul 03 10:20:36.735939 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.735917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"]
Jul 03 10:20:36.772873 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.772808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f572bb-5281-4b75-bb29-31e4116cb01d-openshift-service-ca\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.772873 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.772838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7qz4\" (UniqueName: \"kubernetes.io/projected/69f572bb-5281-4b75-bb29-31e4116cb01d-kube-api-access-b7qz4\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.772873 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.772862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69f572bb-5281-4b75-bb29-31e4116cb01d-maas-api-tls\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.874322 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.874292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f572bb-5281-4b75-bb29-31e4116cb01d-openshift-service-ca\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.874322 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.874323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7qz4\" (UniqueName: \"kubernetes.io/projected/69f572bb-5281-4b75-bb29-31e4116cb01d-kube-api-access-b7qz4\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.874726 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.874345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69f572bb-5281-4b75-bb29-31e4116cb01d-maas-api-tls\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.875044 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.875026    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f572bb-5281-4b75-bb29-31e4116cb01d-openshift-service-ca\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.876685 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.876664    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69f572bb-5281-4b75-bb29-31e4116cb01d-maas-api-tls\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:36.896663 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:36.896638    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7qz4\" (UniqueName: \"kubernetes.io/projected/69f572bb-5281-4b75-bb29-31e4116cb01d-kube-api-access-b7qz4\") pod \"maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") " pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:37.034442 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:37.034358    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:37.170125 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:37.170097    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"]
Jul 03 10:20:37.172675 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:20:37.172652    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f572bb_5281_4b75_bb29_31e4116cb01d.slice/crio-e5429e9fb99bd7d240d1f28dc05736ad1cec50247d0ea2afc548db9593f7f644 WatchSource:0}: Error finding container e5429e9fb99bd7d240d1f28dc05736ad1cec50247d0ea2afc548db9593f7f644: Status 404 returned error can't find the container with id e5429e9fb99bd7d240d1f28dc05736ad1cec50247d0ea2afc548db9593f7f644
Jul 03 10:20:37.542439 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:37.542401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5" event={"ID":"69f572bb-5281-4b75-bb29-31e4116cb01d","Type":"ContainerStarted","Data":"e5429e9fb99bd7d240d1f28dc05736ad1cec50247d0ea2afc548db9593f7f644"}
Jul 03 10:20:38.548410 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:38.548375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5" event={"ID":"69f572bb-5281-4b75-bb29-31e4116cb01d","Type":"ContainerStarted","Data":"bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966"}
Jul 03 10:20:38.548816 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:38.548444    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:38.567102 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:38.567059    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5" podStartSLOduration=2.190293779 podStartE2EDuration="2.567042992s" totalImagesPullingTime="376.749213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:20:38.565215968 +0000 UTC m=+2242.733691370" watchObservedRunningTime="2026-07-03 10:20:38.567042992 +0000 UTC m=+2242.735518392"
Jul 03 10:20:44.560551 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:44.560515    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:49.813837 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:49.813787    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"]
Jul 03 10:20:49.814614 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:49.814318    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm" podUID="72cf37f8-6dec-4631-95fa-eed52fb7795f" containerName="maas-api" containerID="cri-o://924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c" gracePeriod=30
Jul 03 10:20:50.062040 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.062013    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:50.202126 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.202041    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls\") pod \"72cf37f8-6dec-4631-95fa-eed52fb7795f\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") "
Jul 03 10:20:50.202294 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.202132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cf37f8-6dec-4631-95fa-eed52fb7795f-openshift-service-ca\") pod \"72cf37f8-6dec-4631-95fa-eed52fb7795f\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") "
Jul 03 10:20:50.202294 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.202167    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q46dh\" (UniqueName: \"kubernetes.io/projected/72cf37f8-6dec-4631-95fa-eed52fb7795f-kube-api-access-q46dh\") pod \"72cf37f8-6dec-4631-95fa-eed52fb7795f\" (UID: \"72cf37f8-6dec-4631-95fa-eed52fb7795f\") "
Jul 03 10:20:50.202587 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.202553    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72cf37f8-6dec-4631-95fa-eed52fb7795f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "72cf37f8-6dec-4631-95fa-eed52fb7795f" (UID: "72cf37f8-6dec-4631-95fa-eed52fb7795f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:20:50.204631 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.204606    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "72cf37f8-6dec-4631-95fa-eed52fb7795f" (UID: "72cf37f8-6dec-4631-95fa-eed52fb7795f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:20:50.204929 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.204896    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72cf37f8-6dec-4631-95fa-eed52fb7795f-kube-api-access-q46dh" (OuterVolumeSpecName: "kube-api-access-q46dh") pod "72cf37f8-6dec-4631-95fa-eed52fb7795f" (UID: "72cf37f8-6dec-4631-95fa-eed52fb7795f"). InnerVolumeSpecName "kube-api-access-q46dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:20:50.303152 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.303125    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/72cf37f8-6dec-4631-95fa-eed52fb7795f-openshift-service-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:50.303152 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.303149    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q46dh\" (UniqueName: \"kubernetes.io/projected/72cf37f8-6dec-4631-95fa-eed52fb7795f-kube-api-access-q46dh\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:50.303301 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.303160    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72cf37f8-6dec-4631-95fa-eed52fb7795f-maas-api-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:50.613020 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.612987    2580 generic.go:356] "Generic (PLEG): container finished" podID="72cf37f8-6dec-4631-95fa-eed52fb7795f" containerID="924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c" exitCode=0
Jul 03 10:20:50.613169 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.613042    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"
Jul 03 10:20:50.613169 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.613084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm" event={"ID":"72cf37f8-6dec-4631-95fa-eed52fb7795f","Type":"ContainerDied","Data":"924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c"}
Jul 03 10:20:50.613169 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.613149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm" event={"ID":"72cf37f8-6dec-4631-95fa-eed52fb7795f","Type":"ContainerDied","Data":"c8ce47c99373e722ea5c8b0f52e43ce220b726d52b6ce944573395a5ce89bbb7"}
Jul 03 10:20:50.613262 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.613184    2580 scope.go:117] "RemoveContainer" containerID="924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c"
Jul 03 10:20:50.621808 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.621790    2580 scope.go:117] "RemoveContainer" containerID="924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c"
Jul 03 10:20:50.622100 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:20:50.622082    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c\": container with ID starting with 924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c not found: ID does not exist" containerID="924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c"
Jul 03 10:20:50.622169 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.622107    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c"} err="failed to get container status \"924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c\": rpc error: code = NotFound desc = could not find container \"924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c\": container with ID starting with 924f6e53b6f4016547a917d9bc2e2d6f8cd7265d8cd78de0ea13574a3274f95c not found: ID does not exist"
Jul 03 10:20:50.641602 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.641567    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"]
Jul 03 10:20:50.643875 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:50.643844    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-f98768-74b8bf65c8-ng6rm"]
Jul 03 10:20:51.537814 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:51.537777    2580 patch_prober.go:28] interesting pod/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 03 10:20:51.538268 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:51.537848    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 03 10:20:51.621655 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:51.621580    2580 generic.go:356] "Generic (PLEG): container finished" podID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerID="8bcd821255a1360e59c3f89d1dfd0038446dc873bb08f5ec217e933bc1b70cc8" exitCode=0
Jul 03 10:20:51.621655 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:51.621646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" event={"ID":"9ccfe53d-2f88-450c-8556-e7e774c7ee42","Type":"ContainerDied","Data":"8bcd821255a1360e59c3f89d1dfd0038446dc873bb08f5ec217e933bc1b70cc8"}
Jul 03 10:20:51.622004 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:51.621990    2580 scope.go:117] "RemoveContainer" containerID="8bcd821255a1360e59c3f89d1dfd0038446dc873bb08f5ec217e933bc1b70cc8"
Jul 03 10:20:51.622962 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:51.622937    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:20:51.623021 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:51.623003    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:20:51.623115 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:51.623035    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:20:52.290240 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:52.290208    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72cf37f8-6dec-4631-95fa-eed52fb7795f" path="/var/lib/kubelet/pods/72cf37f8-6dec-4631-95fa-eed52fb7795f/volumes"
Jul 03 10:20:52.629006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:52.628918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" event={"ID":"9ccfe53d-2f88-450c-8556-e7e774c7ee42","Type":"ContainerStarted","Data":"f97abba17e231ef7800482d321ff6493334e144b902d8065a739ccc8ae490599"}
Jul 03 10:20:52.864105 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:52.864067    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:52.864362 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:52.864335    2580 patch_prober.go:28] interesting pod/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 03 10:20:52.864421 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:52.864402    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 03 10:20:53.864744 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:53.864706    2580 patch_prober.go:28] interesting pod/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 03 10:20:53.865139 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:53.864785    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 03 10:20:54.865036 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:54.864993    2580 patch_prober.go:28] interesting pod/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 03 10:20:54.865576 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:54.865059    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 03 10:20:55.864643 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:55.864606    2580 patch_prober.go:28] interesting pod/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 03 10:20:55.864861 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:55.864662    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 03 10:20:56.811666 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:56.811624    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"]
Jul 03 10:20:56.812107 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:56.811892    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5" podUID="69f572bb-5281-4b75-bb29-31e4116cb01d" containerName="maas-api" containerID="cri-o://bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966" gracePeriod=30
Jul 03 10:20:56.868045 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:56.868019    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:56.868293 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:56.868277    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:56.868986 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:56.868966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:20:57.060616 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.060595    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:57.167504 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.167427    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7qz4\" (UniqueName: \"kubernetes.io/projected/69f572bb-5281-4b75-bb29-31e4116cb01d-kube-api-access-b7qz4\") pod \"69f572bb-5281-4b75-bb29-31e4116cb01d\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") "
Jul 03 10:20:57.167504 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.167501    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69f572bb-5281-4b75-bb29-31e4116cb01d-maas-api-tls\") pod \"69f572bb-5281-4b75-bb29-31e4116cb01d\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") "
Jul 03 10:20:57.167725 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.167520    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f572bb-5281-4b75-bb29-31e4116cb01d-openshift-service-ca\") pod \"69f572bb-5281-4b75-bb29-31e4116cb01d\" (UID: \"69f572bb-5281-4b75-bb29-31e4116cb01d\") "
Jul 03 10:20:57.167981 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.167958    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69f572bb-5281-4b75-bb29-31e4116cb01d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69f572bb-5281-4b75-bb29-31e4116cb01d" (UID: "69f572bb-5281-4b75-bb29-31e4116cb01d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:20:57.169568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.169545    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69f572bb-5281-4b75-bb29-31e4116cb01d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69f572bb-5281-4b75-bb29-31e4116cb01d" (UID: "69f572bb-5281-4b75-bb29-31e4116cb01d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:20:57.169626 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.169603    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69f572bb-5281-4b75-bb29-31e4116cb01d-kube-api-access-b7qz4" (OuterVolumeSpecName: "kube-api-access-b7qz4") pod "69f572bb-5281-4b75-bb29-31e4116cb01d" (UID: "69f572bb-5281-4b75-bb29-31e4116cb01d"). InnerVolumeSpecName "kube-api-access-b7qz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:20:57.268783 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.268716    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69f572bb-5281-4b75-bb29-31e4116cb01d-maas-api-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:57.268783 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.268779    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f572bb-5281-4b75-bb29-31e4116cb01d-openshift-service-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:57.268961 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.268796    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7qz4\" (UniqueName: \"kubernetes.io/projected/69f572bb-5281-4b75-bb29-31e4116cb01d-kube-api-access-b7qz4\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:20:57.667788 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.667757    2580 generic.go:356] "Generic (PLEG): container finished" podID="69f572bb-5281-4b75-bb29-31e4116cb01d" containerID="bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966" exitCode=0
Jul 03 10:20:57.667967 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.667801    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"
Jul 03 10:20:57.667967 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.667837    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5" event={"ID":"69f572bb-5281-4b75-bb29-31e4116cb01d","Type":"ContainerDied","Data":"bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966"}
Jul 03 10:20:57.667967 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.667888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5" event={"ID":"69f572bb-5281-4b75-bb29-31e4116cb01d","Type":"ContainerDied","Data":"e5429e9fb99bd7d240d1f28dc05736ad1cec50247d0ea2afc548db9593f7f644"}
Jul 03 10:20:57.667967 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.667910    2580 scope.go:117] "RemoveContainer" containerID="bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966"
Jul 03 10:20:57.676945 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.676929    2580 scope.go:117] "RemoveContainer" containerID="bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966"
Jul 03 10:20:57.677185 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:20:57.677167    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966\": container with ID starting with bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966 not found: ID does not exist" containerID="bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966"
Jul 03 10:20:57.677238 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.677198    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966"} err="failed to get container status \"bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966\": rpc error: code = NotFound desc = could not find container \"bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966\": container with ID starting with bae4d9dfb0c77fbd65073e9309056d8fe2057a8e96a5a3d332387f5da684a966 not found: ID does not exist"
Jul 03 10:20:57.693019 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.692998    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"]
Jul 03 10:20:57.697100 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:57.697082    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4ce0f2-9b684d4b9-vtzg5"]
Jul 03 10:20:58.289941 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:20:58.289911    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69f572bb-5281-4b75-bb29-31e4116cb01d" path="/var/lib/kubelet/pods/69f572bb-5281-4b75-bb29-31e4116cb01d/volumes"
Jul 03 10:21:04.596763 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:04.596711    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"]
Jul 03 10:21:04.597199 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:04.596936    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy" containerID="cri-o://f97abba17e231ef7800482d321ff6493334e144b902d8065a739ccc8ae490599" gracePeriod=30
Jul 03 10:21:08.680551 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.680517    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"]
Jul 03 10:21:08.680989 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.680972    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f572bb-5281-4b75-bb29-31e4116cb01d" containerName="maas-api"
Jul 03 10:21:08.680989 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.680991    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f572bb-5281-4b75-bb29-31e4116cb01d" containerName="maas-api"
Jul 03 10:21:08.681093 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.681010    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72cf37f8-6dec-4631-95fa-eed52fb7795f" containerName="maas-api"
Jul 03 10:21:08.681093 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.681015    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="72cf37f8-6dec-4631-95fa-eed52fb7795f" containerName="maas-api"
Jul 03 10:21:08.681161 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.681094    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="69f572bb-5281-4b75-bb29-31e4116cb01d" containerName="maas-api"
Jul 03 10:21:08.681161 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.681102    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="72cf37f8-6dec-4631-95fa-eed52fb7795f" containerName="maas-api"
Jul 03 10:21:08.683169 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.683151    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:08.685614 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.685594    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bh87n\""
Jul 03 10:21:08.685764 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.685717    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-1fc47c-serving-cert\""
Jul 03 10:21:08.698542 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.698517    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"]
Jul 03 10:21:08.762279 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.762243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ef778c-3925-4fb1-a966-23391004d288-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:08.762466 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.762316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:08.762466 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.762361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2pb\" (UniqueName: \"kubernetes.io/projected/e8ef778c-3925-4fb1-a966-23391004d288-kube-api-access-hn2pb\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:08.863078 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.863047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ef778c-3925-4fb1-a966-23391004d288-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:08.863254 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.863121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:08.863254 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.863178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2pb\" (UniqueName: \"kubernetes.io/projected/e8ef778c-3925-4fb1-a966-23391004d288-kube-api-access-hn2pb\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:08.863329 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:21:08.863262    2580 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-1fc47c-serving-cert: secret "maas-api-e2e-shared-a-1fc47c-serving-cert" not found
Jul 03 10:21:08.863364 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:21:08.863331    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls podName:e8ef778c-3925-4fb1-a966-23391004d288 nodeName:}" failed. No retries permitted until 2026-07-03 10:21:09.363316271 +0000 UTC m=+2273.531791654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls") pod "maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6" (UID: "e8ef778c-3925-4fb1-a966-23391004d288") : secret "maas-api-e2e-shared-a-1fc47c-serving-cert" not found
Jul 03 10:21:08.863856 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.863840    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ef778c-3925-4fb1-a966-23391004d288-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:08.875955 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:08.875926    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2pb\" (UniqueName: \"kubernetes.io/projected/e8ef778c-3925-4fb1-a966-23391004d288-kube-api-access-hn2pb\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:09.368366 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.368334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:09.370947 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.370920    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls\") pod \"maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") " pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:09.593812 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.593782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:09.731989 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.731960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"]
Jul 03 10:21:09.732898 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.732871    2580 generic.go:356] "Generic (PLEG): container finished" podID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerID="f97abba17e231ef7800482d321ff6493334e144b902d8065a739ccc8ae490599" exitCode=0
Jul 03 10:21:09.733009 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.732907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" event={"ID":"9ccfe53d-2f88-450c-8556-e7e774c7ee42","Type":"ContainerDied","Data":"f97abba17e231ef7800482d321ff6493334e144b902d8065a739ccc8ae490599"}
Jul 03 10:21:09.733009 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.732950    2580 scope.go:117] "RemoveContainer" containerID="8bcd821255a1360e59c3f89d1dfd0038446dc873bb08f5ec217e933bc1b70cc8"
Jul 03 10:21:09.735186 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:21:09.735165    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ef778c_3925_4fb1_a966_23391004d288.slice/crio-b1e8f5bfa3bed95ab466b9319bb0b93eb6bce98199675d8424ad22b0e1aa4143 WatchSource:0}: Error finding container b1e8f5bfa3bed95ab466b9319bb0b93eb6bce98199675d8424ad22b0e1aa4143: Status 404 returned error can't find the container with id b1e8f5bfa3bed95ab466b9319bb0b93eb6bce98199675d8424ad22b0e1aa4143
Jul 03 10:21:09.836928 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.836907    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:21:09.973801 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.973771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-podinfo\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.973801 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.973805    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-data\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.974018 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.973833    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzvqs\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-kube-api-access-qzvqs\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.974018 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.973884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istiod-ca-cert\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.974018 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.973913    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-token\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.974018 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.973957    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-socket\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.974018 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974000    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-envoy\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.974268 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974054    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-certs\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.974268 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974096    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-credential-socket\") pod \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\" (UID: \"9ccfe53d-2f88-450c-8556-e7e774c7ee42\") "
Jul 03 10:21:09.974385 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974269    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:09.974385 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974306    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:21:09.974517 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974408    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istiod-ca-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:09.974581 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974526    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:09.974682 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974643    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:09.974788 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974708    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:09.974788 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.974718    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:09.976230 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.976202    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-kube-api-access-qzvqs" (OuterVolumeSpecName: "kube-api-access-qzvqs") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "kube-api-access-qzvqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:21:09.976367 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.976275    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:09.976482 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.976460    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:21:09.976482 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:09.976463    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ccfe53d-2f88-450c-8556-e7e774c7ee42" (UID: "9ccfe53d-2f88-450c-8556-e7e774c7ee42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:21:10.075316 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.075278    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-workload-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:10.075316 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.075306    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-credential-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:10.075316 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.075317    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-podinfo\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:10.075316 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.075325    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-data\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:10.075634 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.075334    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzvqs\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-kube-api-access-qzvqs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:10.075634 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.075343    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-token\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:10.075634 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.075351    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ccfe53d-2f88-450c-8556-e7e774c7ee42-istio-envoy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:21:10.739102 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.739066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6" event={"ID":"e8ef778c-3925-4fb1-a966-23391004d288","Type":"ContainerStarted","Data":"0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d"}
Jul 03 10:21:10.739547 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.739128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6" event={"ID":"e8ef778c-3925-4fb1-a966-23391004d288","Type":"ContainerStarted","Data":"b1e8f5bfa3bed95ab466b9319bb0b93eb6bce98199675d8424ad22b0e1aa4143"}
Jul 03 10:21:10.739547 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.739174    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:10.740404 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.740388    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"
Jul 03 10:21:10.740480 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.740386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz" event={"ID":"9ccfe53d-2f88-450c-8556-e7e774c7ee42","Type":"ContainerDied","Data":"2596151dd4028b25018e135de154b86e6aff628c3aeeaaf3ad4df11bb145a015"}
Jul 03 10:21:10.740516 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.740507    2580 scope.go:117] "RemoveContainer" containerID="f97abba17e231ef7800482d321ff6493334e144b902d8065a739ccc8ae490599"
Jul 03 10:21:10.766678 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.766638    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6" podStartSLOduration=2.412737366 podStartE2EDuration="2.766622559s" totalImagesPullingTime="353.885193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:21:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:21:10.764434996 +0000 UTC m=+2274.932910397" watchObservedRunningTime="2026-07-03 10:21:10.766622559 +0000 UTC m=+2274.935097961"
Jul 03 10:21:10.785214 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.785185    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"]
Jul 03 10:21:10.789664 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:10.789643    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4ce0f2-openshift-default-7bff44d7b9-gknwz"]
Jul 03 10:21:12.289461 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:12.289432    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" path="/var/lib/kubelet/pods/9ccfe53d-2f88-450c-8556-e7e774c7ee42/volumes"
Jul 03 10:21:13.673553 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.673515    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"]
Jul 03 10:21:13.673925 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.673863    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy"
Jul 03 10:21:13.673925 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.673874    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy"
Jul 03 10:21:13.673925 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.673882    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy"
Jul 03 10:21:13.673925 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.673887    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy"
Jul 03 10:21:13.674055 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.673940    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy"
Jul 03 10:21:13.676528 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.676510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.679887 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.679861    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-12921d-openshift-default-dockercfg-gl666\""
Jul 03 10:21:13.694453 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.694432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"]
Jul 03 10:21:13.806129 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvp5\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-kube-api-access-zrvp5\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.806305 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-data\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.806305 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193d8763-136f-483c-ab09-2fb9555ee967-istio-podinfo\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.806305 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-socket\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.806305 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-istio-token\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.806478 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193d8763-136f-483c-ab09-2fb9555ee967-istiod-ca-cert\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.806478 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-certs\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.806478 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-credential-socket\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.806478 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.806400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-envoy\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907108 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvp5\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-kube-api-access-zrvp5\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907108 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-data\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907365 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193d8763-136f-483c-ab09-2fb9555ee967-istio-podinfo\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907365 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-socket\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907365 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-istio-token\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907365 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193d8763-136f-483c-ab09-2fb9555ee967-istiod-ca-cert\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907365 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-certs\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907365 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-credential-socket\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.907365 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-envoy\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.908135 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.907848    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-credential-socket\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.908135 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.908090    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-certs\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.908303 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.908255    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193d8763-136f-483c-ab09-2fb9555ee967-istiod-ca-cert\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.908303 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.908256    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-data\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.908450 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.908424    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-socket\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.909792 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.909772    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-envoy\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.910047 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.910029    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193d8763-136f-483c-ab09-2fb9555ee967-istio-podinfo\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.920122 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.920098    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-istio-token\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.920489 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.920471    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvp5\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-kube-api-access-zrvp5\") pod \"e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") " pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:13.987183 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:13.987114    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:14.121568 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:14.121544    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"]
Jul 03 10:21:14.123043 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:21:14.123016    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193d8763_136f_483c_ab09_2fb9555ee967.slice/crio-937ec9bf8983fbf201e655ae6764faf9dbee6662868240bd5ad312aec05e78ae WatchSource:0}: Error finding container 937ec9bf8983fbf201e655ae6764faf9dbee6662868240bd5ad312aec05e78ae: Status 404 returned error can't find the container with id 937ec9bf8983fbf201e655ae6764faf9dbee6662868240bd5ad312aec05e78ae
Jul 03 10:21:14.125189 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:14.125156    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:21:14.125283 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:14.125219    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:21:14.125283 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:14.125263    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:21:14.762952 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:14.762919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" event={"ID":"193d8763-136f-483c-ab09-2fb9555ee967","Type":"ContainerStarted","Data":"5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64"}
Jul 03 10:21:14.763394 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:14.763263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" event={"ID":"193d8763-136f-483c-ab09-2fb9555ee967","Type":"ContainerStarted","Data":"937ec9bf8983fbf201e655ae6764faf9dbee6662868240bd5ad312aec05e78ae"}
Jul 03 10:21:14.788777 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:14.788713    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" podStartSLOduration=1.788698286 podStartE2EDuration="1.788698286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:21:14.786873552 +0000 UTC m=+2278.955348955" watchObservedRunningTime="2026-07-03 10:21:14.788698286 +0000 UTC m=+2278.957173687"
Jul 03 10:21:14.988113 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:14.988068    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:15.993162 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:15.993128    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:16.470006 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:16.469975    2580 scope.go:117] "RemoveContainer" containerID="565643b0a229651cd0f4ddbe2d9afd99c626d286396f64bd8b39d9094d99a261"
Jul 03 10:21:16.752091 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:16.752008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:21:16.774177 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:16.774150    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:16.775212 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:16.775193    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:31.775270 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:31.775232    2580 patch_prober.go:28] interesting pod/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 03 10:21:31.775671 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:31.775295    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 03 10:21:31.848942 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:31.848910    2580 generic.go:356] "Generic (PLEG): container finished" podID="193d8763-136f-483c-ab09-2fb9555ee967" containerID="5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64" exitCode=0
Jul 03 10:21:31.849123 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:31.848992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" event={"ID":"193d8763-136f-483c-ab09-2fb9555ee967","Type":"ContainerDied","Data":"5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64"}
Jul 03 10:21:31.849413 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:31.849395    2580 scope.go:117] "RemoveContainer" containerID="5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64"
Jul 03 10:21:31.850401 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:31.850367    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:21:31.850490 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:31.850441    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:21:31.850490 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:31.850476    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 03 10:21:32.863439 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:32.863407    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" event={"ID":"193d8763-136f-483c-ab09-2fb9555ee967","Type":"ContainerStarted","Data":"b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09"}
Jul 03 10:21:32.987541 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:32.987507    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:32.987900 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:32.987875    2580 patch_prober.go:28] interesting pod/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 03 10:21:32.988005 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:32.987925    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 03 10:21:33.987901 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:33.987864    2580 patch_prober.go:28] interesting pod/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 03 10:21:33.988284 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:33.987918    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 03 10:21:34.988506 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:34.988466    2580 patch_prober.go:28] interesting pod/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 03 10:21:34.988999 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:34.988544    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 03 10:21:35.004015 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.003981    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"]
Jul 03 10:21:35.004374 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.004361    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ccfe53d-2f88-450c-8556-e7e774c7ee42" containerName="istio-proxy"
Jul 03 10:21:35.011742 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.011694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.014353 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.014322    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1fc47c\"/\"openshift-service-ca.crt\""
Jul 03 10:21:35.014485 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.014323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1fc47c\"/\"default-dockercfg-46qkc\""
Jul 03 10:21:35.015162 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.015139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1fc47c\"/\"kube-root-ca.crt\""
Jul 03 10:21:35.015279 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.015241    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1fc47c\"/\"auth-test-model-1fc47c-kserve-self-signed-certs\""
Jul 03 10:21:35.019288 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.019040    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"]
Jul 03 10:21:35.095349 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.095317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-home\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.095522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.095362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-dshm\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.095522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.095382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-tmp-dir\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.095522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.095409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe72210-6d86-4e54-8e2f-61a739b35837-tls-certs\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.095522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.095431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcnq2\" (UniqueName: \"kubernetes.io/projected/afe72210-6d86-4e54-8e2f-61a739b35837-kube-api-access-kcnq2\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.095522 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.095465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-model-cache\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.196795 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.196756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-home\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.197000 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.196808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-dshm\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.197000 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.196827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-tmp-dir\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.197000 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.196855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe72210-6d86-4e54-8e2f-61a739b35837-tls-certs\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.197000 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.196877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcnq2\" (UniqueName: \"kubernetes.io/projected/afe72210-6d86-4e54-8e2f-61a739b35837-kube-api-access-kcnq2\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.197000 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.196907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-model-cache\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.197274 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.197181    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-home\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.197274 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.197256    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-tmp-dir\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.197351 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.197278    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-model-cache\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.199174 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.199155    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-dshm\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.199281 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.199266    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe72210-6d86-4e54-8e2f-61a739b35837-tls-certs\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.205067 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.205047    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcnq2\" (UniqueName: \"kubernetes.io/projected/afe72210-6d86-4e54-8e2f-61a739b35837-kube-api-access-kcnq2\") pod \"auth-test-model-1fc47c-kserve-7f5848747f-k5xqc\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") " pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.321859 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.321820    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:35.508803 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.508773    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"]
Jul 03 10:21:35.511357 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:21:35.511317    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafe72210_6d86_4e54_8e2f_61a739b35837.slice/crio-e0c1597ff74252773db8314b0f874d0c0e048eb42129f969ea82327a5ce15825 WatchSource:0}: Error finding container e0c1597ff74252773db8314b0f874d0c0e048eb42129f969ea82327a5ce15825: Status 404 returned error can't find the container with id e0c1597ff74252773db8314b0f874d0c0e048eb42129f969ea82327a5ce15825
Jul 03 10:21:35.880691 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.880591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc" event={"ID":"afe72210-6d86-4e54-8e2f-61a739b35837","Type":"ContainerStarted","Data":"14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4"}
Jul 03 10:21:35.880691 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.880636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc" event={"ID":"afe72210-6d86-4e54-8e2f-61a739b35837","Type":"ContainerStarted","Data":"e0c1597ff74252773db8314b0f874d0c0e048eb42129f969ea82327a5ce15825"}
Jul 03 10:21:35.901752 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.901689    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc" podStartSLOduration=1.9016754850000002 podStartE2EDuration="1.901675485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:21:35.900159327 +0000 UTC m=+2300.068634732" watchObservedRunningTime="2026-07-03 10:21:35.901675485 +0000 UTC m=+2300.070150886"
Jul 03 10:21:35.988443 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.988406    2580 patch_prober.go:28] interesting pod/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 03 10:21:35.988612 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:35.988474    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 03 10:21:36.991545 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:36.991517    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:36.991993 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:36.991792    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:36.992467 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:36.992452    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:21:45.322493 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:45.322452    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:45.322994 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:45.322508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:45.334751 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:45.334711    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:21:45.948944 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:21:45.948914    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:24:09.787319 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:09.787279    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"]
Jul 03 10:24:24.807303 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:24.807240    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc" podUID="afe72210-6d86-4e54-8e2f-61a739b35837" containerName="main" containerID="cri-o://14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4" gracePeriod=45
Jul 03 10:24:25.050700 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.050674    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:24:25.156791 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.156669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-tmp-dir\") pod \"afe72210-6d86-4e54-8e2f-61a739b35837\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") "
Jul 03 10:24:25.156964 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.156837    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-home\") pod \"afe72210-6d86-4e54-8e2f-61a739b35837\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") "
Jul 03 10:24:25.156964 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.156869    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcnq2\" (UniqueName: \"kubernetes.io/projected/afe72210-6d86-4e54-8e2f-61a739b35837-kube-api-access-kcnq2\") pod \"afe72210-6d86-4e54-8e2f-61a739b35837\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") "
Jul 03 10:24:25.156964 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.156886    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-model-cache\") pod \"afe72210-6d86-4e54-8e2f-61a739b35837\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") "
Jul 03 10:24:25.156964 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.156917    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-dshm\") pod \"afe72210-6d86-4e54-8e2f-61a739b35837\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") "
Jul 03 10:24:25.156964 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.156955    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "afe72210-6d86-4e54-8e2f-61a739b35837" (UID: "afe72210-6d86-4e54-8e2f-61a739b35837"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:24:25.157262 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.156971    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe72210-6d86-4e54-8e2f-61a739b35837-tls-certs\") pod \"afe72210-6d86-4e54-8e2f-61a739b35837\" (UID: \"afe72210-6d86-4e54-8e2f-61a739b35837\") "
Jul 03 10:24:25.157262 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.157143    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-home" (OuterVolumeSpecName: "home") pod "afe72210-6d86-4e54-8e2f-61a739b35837" (UID: "afe72210-6d86-4e54-8e2f-61a739b35837"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:24:25.157262 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.157157    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-model-cache" (OuterVolumeSpecName: "model-cache") pod "afe72210-6d86-4e54-8e2f-61a739b35837" (UID: "afe72210-6d86-4e54-8e2f-61a739b35837"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:24:25.157377 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.157290    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-home\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:24:25.157377 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.157311    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-model-cache\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:24:25.157377 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.157331    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-tmp-dir\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:24:25.159227 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.159181    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-dshm" (OuterVolumeSpecName: "dshm") pod "afe72210-6d86-4e54-8e2f-61a739b35837" (UID: "afe72210-6d86-4e54-8e2f-61a739b35837"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:24:25.159552 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.159531    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afe72210-6d86-4e54-8e2f-61a739b35837-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "afe72210-6d86-4e54-8e2f-61a739b35837" (UID: "afe72210-6d86-4e54-8e2f-61a739b35837"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:24:25.159645 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.159554    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe72210-6d86-4e54-8e2f-61a739b35837-kube-api-access-kcnq2" (OuterVolumeSpecName: "kube-api-access-kcnq2") pod "afe72210-6d86-4e54-8e2f-61a739b35837" (UID: "afe72210-6d86-4e54-8e2f-61a739b35837"). InnerVolumeSpecName "kube-api-access-kcnq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:24:25.219126 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.219092    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"]
Jul 03 10:24:25.219457 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.219445    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe72210-6d86-4e54-8e2f-61a739b35837" containerName="main"
Jul 03 10:24:25.219502 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.219459    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe72210-6d86-4e54-8e2f-61a739b35837" containerName="main"
Jul 03 10:24:25.219537 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.219521    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe72210-6d86-4e54-8e2f-61a739b35837" containerName="main"
Jul 03 10:24:25.222519 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.222502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.225460 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.225440    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1fc47c\"/\"sub-test-model-1fc47c-kserve-self-signed-certs\""
Jul 03 10:24:25.237946 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.237923    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"]
Jul 03 10:24:25.258166 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-dshm\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.258290 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97d62728-3f70-48d6-904b-558f4a067a2a-tls-certs\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.258290 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-home\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.258290 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-model-cache\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.258403 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-tmp-dir\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.258403 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lx7h\" (UniqueName: \"kubernetes.io/projected/97d62728-3f70-48d6-904b-558f4a067a2a-kube-api-access-8lx7h\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.258515 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258409    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcnq2\" (UniqueName: \"kubernetes.io/projected/afe72210-6d86-4e54-8e2f-61a739b35837-kube-api-access-kcnq2\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:24:25.258515 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258421    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afe72210-6d86-4e54-8e2f-61a739b35837-dshm\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:24:25.258515 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.258431    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afe72210-6d86-4e54-8e2f-61a739b35837-tls-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:24:25.359571 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.359543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-tmp-dir\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.359777 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.359578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lx7h\" (UniqueName: \"kubernetes.io/projected/97d62728-3f70-48d6-904b-558f4a067a2a-kube-api-access-8lx7h\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.359777 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.359604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-dshm\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.359777 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.359625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97d62728-3f70-48d6-904b-558f4a067a2a-tls-certs\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.359777 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.359666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-home\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.359777 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.359682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-model-cache\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.360033 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.360007    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-tmp-dir\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.360098 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.360012    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-model-cache\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.360207 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.360189    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-home\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.361942 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.361918    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-dshm\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.362189 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.362173    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97d62728-3f70-48d6-904b-558f4a067a2a-tls-certs\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.369318 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.369291    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lx7h\" (UniqueName: \"kubernetes.io/projected/97d62728-3f70-48d6-904b-558f4a067a2a-kube-api-access-8lx7h\") pod \"sub-test-model-1fc47c-kserve-868956d48c-zj4p8\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") " pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.531432 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.531392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:25.666845 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.666806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"]
Jul 03 10:24:25.668156 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:24:25.668133    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97d62728_3f70_48d6_904b_558f4a067a2a.slice/crio-0888bf64d8b49fd82de01353e4d52f896a77951dc8c5e41f5dba658190f53e1e WatchSource:0}: Error finding container 0888bf64d8b49fd82de01353e4d52f896a77951dc8c5e41f5dba658190f53e1e: Status 404 returned error can't find the container with id 0888bf64d8b49fd82de01353e4d52f896a77951dc8c5e41f5dba658190f53e1e
Jul 03 10:24:25.721895 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.721862    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8" event={"ID":"97d62728-3f70-48d6-904b-558f4a067a2a","Type":"ContainerStarted","Data":"0888bf64d8b49fd82de01353e4d52f896a77951dc8c5e41f5dba658190f53e1e"}
Jul 03 10:24:25.723183 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.723157    2580 generic.go:356] "Generic (PLEG): container finished" podID="afe72210-6d86-4e54-8e2f-61a739b35837" containerID="14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4" exitCode=0
Jul 03 10:24:25.723302 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.723188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc" event={"ID":"afe72210-6d86-4e54-8e2f-61a739b35837","Type":"ContainerDied","Data":"14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4"}
Jul 03 10:24:25.723302 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.723216    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"
Jul 03 10:24:25.723302 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.723236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc" event={"ID":"afe72210-6d86-4e54-8e2f-61a739b35837","Type":"ContainerDied","Data":"e0c1597ff74252773db8314b0f874d0c0e048eb42129f969ea82327a5ce15825"}
Jul 03 10:24:25.723302 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.723260    2580 scope.go:117] "RemoveContainer" containerID="14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4"
Jul 03 10:24:25.733202 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.733187    2580 scope.go:117] "RemoveContainer" containerID="14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4"
Jul 03 10:24:25.733505 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:24:25.733481    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4\": container with ID starting with 14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4 not found: ID does not exist" containerID="14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4"
Jul 03 10:24:25.733580 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.733517    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4"} err="failed to get container status \"14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4\": rpc error: code = NotFound desc = could not find container \"14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4\": container with ID starting with 14ded6d7d18886648c14e439b18da4db1db70f4d5d92c05325d64c765f0834c4 not found: ID does not exist"
Jul 03 10:24:25.748566 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.748542    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"]
Jul 03 10:24:25.752888 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:25.752860    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/auth-test-model-1fc47c-kserve-7f5848747f-k5xqc"]
Jul 03 10:24:26.292833 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:26.292799    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe72210-6d86-4e54-8e2f-61a739b35837" path="/var/lib/kubelet/pods/afe72210-6d86-4e54-8e2f-61a739b35837/volumes"
Jul 03 10:24:26.730084 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:26.729991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8" event={"ID":"97d62728-3f70-48d6-904b-558f4a067a2a","Type":"ContainerStarted","Data":"65afc44b64663607b08613f01c90d20287020bd62a0fcdc09af0346ace562e6c"}
Jul 03 10:24:26.751577 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:26.751527    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8" podStartSLOduration=1.751511543 podStartE2EDuration="1.751511543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:24:26.749855059 +0000 UTC m=+2470.918330454" watchObservedRunningTime="2026-07-03 10:24:26.751511543 +0000 UTC m=+2470.919986944"
Jul 03 10:24:35.531869 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:35.531822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:35.532280 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:35.531913    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:35.544473 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:35.544443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:24:35.786472 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:24:35.786391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:25:49.025238 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:25:49.025206    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"]
Jul 03 10:26:04.044571 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.044525    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8" podUID="97d62728-3f70-48d6-904b-558f4a067a2a" containerName="main" containerID="cri-o://65afc44b64663607b08613f01c90d20287020bd62a0fcdc09af0346ace562e6c" gracePeriod=45
Jul 03 10:26:04.241084 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.241048    2580 generic.go:356] "Generic (PLEG): container finished" podID="97d62728-3f70-48d6-904b-558f4a067a2a" containerID="65afc44b64663607b08613f01c90d20287020bd62a0fcdc09af0346ace562e6c" exitCode=0
Jul 03 10:26:04.241227 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.241100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8" event={"ID":"97d62728-3f70-48d6-904b-558f4a067a2a","Type":"ContainerDied","Data":"65afc44b64663607b08613f01c90d20287020bd62a0fcdc09af0346ace562e6c"}
Jul 03 10:26:04.286924 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.286903    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:26:04.332498 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.332433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-model-cache\") pod \"97d62728-3f70-48d6-904b-558f4a067a2a\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") "
Jul 03 10:26:04.332498 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.332466    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lx7h\" (UniqueName: \"kubernetes.io/projected/97d62728-3f70-48d6-904b-558f4a067a2a-kube-api-access-8lx7h\") pod \"97d62728-3f70-48d6-904b-558f4a067a2a\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") "
Jul 03 10:26:04.332498 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.332495    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97d62728-3f70-48d6-904b-558f4a067a2a-tls-certs\") pod \"97d62728-3f70-48d6-904b-558f4a067a2a\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") "
Jul 03 10:26:04.332779 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.332582    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-dshm\") pod \"97d62728-3f70-48d6-904b-558f4a067a2a\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") "
Jul 03 10:26:04.332779 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.332628    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-home\") pod \"97d62728-3f70-48d6-904b-558f4a067a2a\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") "
Jul 03 10:26:04.332779 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.332680    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-tmp-dir\") pod \"97d62728-3f70-48d6-904b-558f4a067a2a\" (UID: \"97d62728-3f70-48d6-904b-558f4a067a2a\") "
Jul 03 10:26:04.332779 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.332723    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-model-cache" (OuterVolumeSpecName: "model-cache") pod "97d62728-3f70-48d6-904b-558f4a067a2a" (UID: "97d62728-3f70-48d6-904b-558f4a067a2a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:26:04.333038 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.332967    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-model-cache\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:26:04.333038 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.333014    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-home" (OuterVolumeSpecName: "home") pod "97d62728-3f70-48d6-904b-558f4a067a2a" (UID: "97d62728-3f70-48d6-904b-558f4a067a2a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:26:04.333038 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.333027    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "97d62728-3f70-48d6-904b-558f4a067a2a" (UID: "97d62728-3f70-48d6-904b-558f4a067a2a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:26:04.334721 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.334695    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-dshm" (OuterVolumeSpecName: "dshm") pod "97d62728-3f70-48d6-904b-558f4a067a2a" (UID: "97d62728-3f70-48d6-904b-558f4a067a2a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:26:04.334863 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.334700    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97d62728-3f70-48d6-904b-558f4a067a2a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "97d62728-3f70-48d6-904b-558f4a067a2a" (UID: "97d62728-3f70-48d6-904b-558f4a067a2a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:26:04.334863 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.334721    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d62728-3f70-48d6-904b-558f4a067a2a-kube-api-access-8lx7h" (OuterVolumeSpecName: "kube-api-access-8lx7h") pod "97d62728-3f70-48d6-904b-558f4a067a2a" (UID: "97d62728-3f70-48d6-904b-558f4a067a2a"). InnerVolumeSpecName "kube-api-access-8lx7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:26:04.434431 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.434400    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-dshm\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:26:04.434431 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.434424    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-home\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:26:04.434431 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.434432    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97d62728-3f70-48d6-904b-558f4a067a2a-tmp-dir\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:26:04.434640 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.434442    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lx7h\" (UniqueName: \"kubernetes.io/projected/97d62728-3f70-48d6-904b-558f4a067a2a-kube-api-access-8lx7h\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:26:04.434640 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:04.434450    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97d62728-3f70-48d6-904b-558f4a067a2a-tls-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:26:05.247655 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:05.247625    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"
Jul 03 10:26:05.248083 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:05.247626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8" event={"ID":"97d62728-3f70-48d6-904b-558f4a067a2a","Type":"ContainerDied","Data":"0888bf64d8b49fd82de01353e4d52f896a77951dc8c5e41f5dba658190f53e1e"}
Jul 03 10:26:05.248083 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:05.247769    2580 scope.go:117] "RemoveContainer" containerID="65afc44b64663607b08613f01c90d20287020bd62a0fcdc09af0346ace562e6c"
Jul 03 10:26:05.269657 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:05.269632    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"]
Jul 03 10:26:05.278212 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:05.278190    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1fc47c/sub-test-model-1fc47c-kserve-868956d48c-zj4p8"]
Jul 03 10:26:06.289746 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:26:06.289705    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97d62728-3f70-48d6-904b-558f4a067a2a" path="/var/lib/kubelet/pods/97d62728-3f70-48d6-904b-558f4a067a2a/volumes"
Jul 03 10:27:18.871778 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:18.871746    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"]
Jul 03 10:27:18.873918 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:18.871937    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6" podUID="e8ef778c-3925-4fb1-a966-23391004d288" containerName="maas-api" containerID="cri-o://0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d" gracePeriod=30
Jul 03 10:27:19.113231 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.113207    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:27:19.178013 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.177938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn2pb\" (UniqueName: \"kubernetes.io/projected/e8ef778c-3925-4fb1-a966-23391004d288-kube-api-access-hn2pb\") pod \"e8ef778c-3925-4fb1-a966-23391004d288\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") "
Jul 03 10:27:19.178013 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.178002    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ef778c-3925-4fb1-a966-23391004d288-openshift-service-ca\") pod \"e8ef778c-3925-4fb1-a966-23391004d288\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") "
Jul 03 10:27:19.178233 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.178070    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls\") pod \"e8ef778c-3925-4fb1-a966-23391004d288\" (UID: \"e8ef778c-3925-4fb1-a966-23391004d288\") "
Jul 03 10:27:19.178343 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.178321    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ef778c-3925-4fb1-a966-23391004d288-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8ef778c-3925-4fb1-a966-23391004d288" (UID: "e8ef778c-3925-4fb1-a966-23391004d288"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:27:19.180073 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.180039    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8ef778c-3925-4fb1-a966-23391004d288" (UID: "e8ef778c-3925-4fb1-a966-23391004d288"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:27:19.180189 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.180119    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ef778c-3925-4fb1-a966-23391004d288-kube-api-access-hn2pb" (OuterVolumeSpecName: "kube-api-access-hn2pb") pod "e8ef778c-3925-4fb1-a966-23391004d288" (UID: "e8ef778c-3925-4fb1-a966-23391004d288"). InnerVolumeSpecName "kube-api-access-hn2pb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:27:19.279289 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.279259    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8ef778c-3925-4fb1-a966-23391004d288-maas-api-tls\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:27:19.279289 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.279285    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn2pb\" (UniqueName: \"kubernetes.io/projected/e8ef778c-3925-4fb1-a966-23391004d288-kube-api-access-hn2pb\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:27:19.279448 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.279296    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8ef778c-3925-4fb1-a966-23391004d288-openshift-service-ca\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:27:19.615407 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.615375    2580 generic.go:356] "Generic (PLEG): container finished" podID="e8ef778c-3925-4fb1-a966-23391004d288" containerID="0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d" exitCode=0
Jul 03 10:27:19.615577 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.615419    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"
Jul 03 10:27:19.615577 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.615462    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6" event={"ID":"e8ef778c-3925-4fb1-a966-23391004d288","Type":"ContainerDied","Data":"0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d"}
Jul 03 10:27:19.615577 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.615511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6" event={"ID":"e8ef778c-3925-4fb1-a966-23391004d288","Type":"ContainerDied","Data":"b1e8f5bfa3bed95ab466b9319bb0b93eb6bce98199675d8424ad22b0e1aa4143"}
Jul 03 10:27:19.615577 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.615532    2580 scope.go:117] "RemoveContainer" containerID="0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d"
Jul 03 10:27:19.624511 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.624495    2580 scope.go:117] "RemoveContainer" containerID="0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d"
Jul 03 10:27:19.624807 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:27:19.624787    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d\": container with ID starting with 0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d not found: ID does not exist" containerID="0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d"
Jul 03 10:27:19.624886 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.624814    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d"} err="failed to get container status \"0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d\": rpc error: code = NotFound desc = could not find container \"0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d\": container with ID starting with 0f71f1aa1f2e22e2707721c3dd0d2fff54a95fa70f363b136c57c00148360d6d not found: ID does not exist"
Jul 03 10:27:19.649576 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.649548    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"]
Jul 03 10:27:19.654459 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:19.654440    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1fc47c-5bb98b448f-7xhw6"]
Jul 03 10:27:20.290464 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:27:20.290431    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ef778c-3925-4fb1-a966-23391004d288" path="/var/lib/kubelet/pods/e8ef778c-3925-4fb1-a966-23391004d288/volumes"
Jul 03 10:28:09.315884 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:09.315806    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"]
Jul 03 10:28:09.316409 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:09.316010    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy" containerID="cri-o://b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09" gracePeriod=30
Jul 03 10:28:14.564008 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.563979    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:28:14.661588 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661493    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-envoy\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.661588 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-data\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.661588 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661574    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-credential-socket\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.661917 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661610    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-socket\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.661917 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661635    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-istio-token\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.661917 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193d8763-136f-483c-ab09-2fb9555ee967-istiod-ca-cert\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.661917 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661691    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-certs\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.661917 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661728    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193d8763-136f-483c-ab09-2fb9555ee967-istio-podinfo\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.662155 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661920    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrvp5\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-kube-api-access-zrvp5\") pod \"193d8763-136f-483c-ab09-2fb9555ee967\" (UID: \"193d8763-136f-483c-ab09-2fb9555ee967\") "
Jul 03 10:28:14.662155 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.661960    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:14.662155 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.662003    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:14.662155 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.662084    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:14.662382 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.662160    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/193d8763-136f-483c-ab09-2fb9555ee967-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:28:14.662382 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.662260    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.662382 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.662279    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193d8763-136f-483c-ab09-2fb9555ee967-istiod-ca-cert\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.662382 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.662293    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-workload-certs\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.662382 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.662305    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-credential-socket\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.662565 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.662440    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-data" (OuterVolumeSpecName: "istio-data") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:14.663769 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.663725    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:14.663983 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.663963    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/193d8763-136f-483c-ab09-2fb9555ee967-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:28:14.664367 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.664340    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-kube-api-access-zrvp5" (OuterVolumeSpecName: "kube-api-access-zrvp5") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "kube-api-access-zrvp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:28:14.664468 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.664341    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-istio-token" (OuterVolumeSpecName: "istio-token") pod "193d8763-136f-483c-ab09-2fb9555ee967" (UID: "193d8763-136f-483c-ab09-2fb9555ee967"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:28:14.763132 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.763099    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-istio-token\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.763132 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.763129    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193d8763-136f-483c-ab09-2fb9555ee967-istio-podinfo\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.763132 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.763138    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrvp5\" (UniqueName: \"kubernetes.io/projected/193d8763-136f-483c-ab09-2fb9555ee967-kube-api-access-zrvp5\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.763370 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.763147    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-envoy\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.763370 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.763156    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193d8763-136f-483c-ab09-2fb9555ee967-istio-data\") on node \"ip-10-0-138-110.ec2.internal\" DevicePath \"\""
Jul 03 10:28:14.897902 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.897868    2580 generic.go:356] "Generic (PLEG): container finished" podID="193d8763-136f-483c-ab09-2fb9555ee967" containerID="b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09" exitCode=0
Jul 03 10:28:14.898100 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.897924    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"
Jul 03 10:28:14.898100 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.897954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" event={"ID":"193d8763-136f-483c-ab09-2fb9555ee967","Type":"ContainerDied","Data":"b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09"}
Jul 03 10:28:14.898100 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.898018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r" event={"ID":"193d8763-136f-483c-ab09-2fb9555ee967","Type":"ContainerDied","Data":"937ec9bf8983fbf201e655ae6764faf9dbee6662868240bd5ad312aec05e78ae"}
Jul 03 10:28:14.898100 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.898049    2580 scope.go:117] "RemoveContainer" containerID="b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09"
Jul 03 10:28:14.907706 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.907690    2580 scope.go:117] "RemoveContainer" containerID="5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64"
Jul 03 10:28:14.915929 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.915886    2580 scope.go:117] "RemoveContainer" containerID="b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09"
Jul 03 10:28:14.916193 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:28:14.916172    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09\": container with ID starting with b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09 not found: ID does not exist" containerID="b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09"
Jul 03 10:28:14.916246 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.916202    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09"} err="failed to get container status \"b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09\": rpc error: code = NotFound desc = could not find container \"b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09\": container with ID starting with b06854b56adf7d64aa6dd0269f541c188bf92bae3f820538ca96079b3942cc09 not found: ID does not exist"
Jul 03 10:28:14.916246 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.916221    2580 scope.go:117] "RemoveContainer" containerID="5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64"
Jul 03 10:28:14.916440 ip-10-0-138-110 kubenswrapper[2580]: E0703 10:28:14.916423    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64\": container with ID starting with 5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64 not found: ID does not exist" containerID="5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64"
Jul 03 10:28:14.916486 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.916446    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64"} err="failed to get container status \"5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64\": rpc error: code = NotFound desc = could not find container \"5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64\": container with ID starting with 5ed88f08931935a9fbb8e28d1080047cef754f9c03fea4acf864371b9c87de64 not found: ID does not exist"
Jul 03 10:28:14.921961 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.921935    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"]
Jul 03 10:28:14.930874 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:14.930847    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-12921d-openshift-default-85d54f9567-6tv5r"]
Jul 03 10:28:15.418357 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:15.418315    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74cfb6d5d8-j6b9t_d0277d5e-3316-4d03-a7b5-83bcd4a274c5/manager/0.log"
Jul 03 10:28:16.010197 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:16.010169    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f66d7cdc8-zc4md_db25c703-90b1-4b62-b5e6-266bec99b347/copy-manifests/0.log"
Jul 03 10:28:16.024515 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:16.024481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f66d7cdc8-zc4md_db25c703-90b1-4b62-b5e6-266bec99b347/manager/0.log"
Jul 03 10:28:16.295792 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:16.295704    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="193d8763-136f-483c-ab09-2fb9555ee967" path="/var/lib/kubelet/pods/193d8763-136f-483c-ab09-2fb9555ee967/volumes"
Jul 03 10:28:16.917615 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:16.917536    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x_4f958681-4f0d-4394-b02a-3a6a304ffcdd/util/0.log"
Jul 03 10:28:16.931933 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:16.931910    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x_4f958681-4f0d-4394-b02a-3a6a304ffcdd/pull/0.log"
Jul 03 10:28:16.942857 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:16.942834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x_4f958681-4f0d-4394-b02a-3a6a304ffcdd/extract/0.log"
Jul 03 10:28:17.075668 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.075640    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc_f096526c-ab65-40d3-b60c-577312100182/util/0.log"
Jul 03 10:28:17.120924 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.120897    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc_f096526c-ab65-40d3-b60c-577312100182/pull/0.log"
Jul 03 10:28:17.140874 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.140850    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc_f096526c-ab65-40d3-b60c-577312100182/extract/0.log"
Jul 03 10:28:17.273391 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.273366    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv_b79e451f-a290-4e03-959c-f1582df17857/extract/0.log"
Jul 03 10:28:17.303945 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.303916    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv_b79e451f-a290-4e03-959c-f1582df17857/util/0.log"
Jul 03 10:28:17.324085 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.324063    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv_b79e451f-a290-4e03-959c-f1582df17857/pull/0.log"
Jul 03 10:28:17.444918 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.444890    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df_ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1/extract/0.log"
Jul 03 10:28:17.462806 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.462782    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df_ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1/util/0.log"
Jul 03 10:28:17.475008 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:17.474980    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df_ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1/pull/0.log"
Jul 03 10:28:18.867751 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:18.867696    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678zm9hx_2d84fba9-755b-4957-951f-b9630727633f/istio-proxy/0.log"
Jul 03 10:28:19.011647 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:19.011615    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lx62t_9c77c2aa-4569-44ed-9916-3d738740089a/discovery/0.log"
Jul 03 10:28:19.647215 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:19.647188    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kkr7c_de6477f5-aa6e-4053-a42d-0d7a29c0818c/payload-processing/0.log"
Jul 03 10:28:20.375145 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:20.375117    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-cgspg_199e858c-007f-4510-a91a-e94d992ea99e/main/0.log"
Jul 03 10:28:20.607110 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:20.607084    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-t9fzv_cfce06ce-c17c-4ef0-8236-6351d6cb8f27/main/0.log"
Jul 03 10:28:28.347248 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:28.347221    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jsp2b_d25e6ce5-0d2c-4fa6-bee2-1d59e6806573/global-pull-secret-syncer/0.log"
Jul 03 10:28:28.559682 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:28.559643    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r4lrs_6bc1bc39-d3a4-4379-bab7-d1b3e94c5f48/konnectivity-agent/0.log"
Jul 03 10:28:28.607095 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:28.607024    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-110.ec2.internal_7a82202aae61ad36a164e7de6fe394cc/haproxy/0.log"
Jul 03 10:28:32.912096 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:32.912035    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x_4f958681-4f0d-4394-b02a-3a6a304ffcdd/extract/0.log"
Jul 03 10:28:32.982259 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:32.982232    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x_4f958681-4f0d-4394-b02a-3a6a304ffcdd/util/0.log"
Jul 03 10:28:33.068300 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.068271    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hlx6x_4f958681-4f0d-4394-b02a-3a6a304ffcdd/pull/0.log"
Jul 03 10:28:33.138743 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.138713    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc_f096526c-ab65-40d3-b60c-577312100182/extract/0.log"
Jul 03 10:28:33.189865 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.189794    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc_f096526c-ab65-40d3-b60c-577312100182/util/0.log"
Jul 03 10:28:33.220056 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.220019    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sk4nc_f096526c-ab65-40d3-b60c-577312100182/pull/0.log"
Jul 03 10:28:33.280512 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.280485    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv_b79e451f-a290-4e03-959c-f1582df17857/extract/0.log"
Jul 03 10:28:33.304251 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.304225    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv_b79e451f-a290-4e03-959c-f1582df17857/util/0.log"
Jul 03 10:28:33.333637 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.333612    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ccnv_b79e451f-a290-4e03-959c-f1582df17857/pull/0.log"
Jul 03 10:28:33.366982 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.366951    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df_ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1/extract/0.log"
Jul 03 10:28:33.395236 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.395209    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df_ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1/util/0.log"
Jul 03 10:28:33.435267 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:33.435243    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17v8df_ba790025-a23f-43e6-b2c5-a3c6fc9d3ac1/pull/0.log"
Jul 03 10:28:36.143126 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.143092    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34329fe6-5ee3-4b55-8cf3-a60e7299ce63/alertmanager/0.log"
Jul 03 10:28:36.165321 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.165295    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34329fe6-5ee3-4b55-8cf3-a60e7299ce63/config-reloader/0.log"
Jul 03 10:28:36.187818 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.187793    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34329fe6-5ee3-4b55-8cf3-a60e7299ce63/kube-rbac-proxy-web/0.log"
Jul 03 10:28:36.211883 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.211862    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34329fe6-5ee3-4b55-8cf3-a60e7299ce63/kube-rbac-proxy/0.log"
Jul 03 10:28:36.236874 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.236842    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34329fe6-5ee3-4b55-8cf3-a60e7299ce63/kube-rbac-proxy-metric/0.log"
Jul 03 10:28:36.259615 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.259593    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34329fe6-5ee3-4b55-8cf3-a60e7299ce63/prom-label-proxy/0.log"
Jul 03 10:28:36.283489 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.283467    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34329fe6-5ee3-4b55-8cf3-a60e7299ce63/init-config-reloader/0.log"
Jul 03 10:28:36.491304 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.491217    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2gf4n_946db8b0-ca83-4416-9793-8201f2645091/node-exporter/0.log"
Jul 03 10:28:36.515027 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.514971    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2gf4n_946db8b0-ca83-4416-9793-8201f2645091/kube-rbac-proxy/0.log"
Jul 03 10:28:36.537499 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:36.537480    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2gf4n_946db8b0-ca83-4416-9793-8201f2645091/init-textfile/0.log"
Jul 03 10:28:38.258827 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.258795    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"]
Jul 03 10:28:38.259200 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259121    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy"
Jul 03 10:28:38.259200 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259132    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy"
Jul 03 10:28:38.259200 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259140    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d62728-3f70-48d6-904b-558f4a067a2a" containerName="main"
Jul 03 10:28:38.259200 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259145    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d62728-3f70-48d6-904b-558f4a067a2a" containerName="main"
Jul 03 10:28:38.259200 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259154    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ef778c-3925-4fb1-a966-23391004d288" containerName="maas-api"
Jul 03 10:28:38.259200 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259159    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ef778c-3925-4fb1-a966-23391004d288" containerName="maas-api"
Jul 03 10:28:38.259200 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259176    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy"
Jul 03 10:28:38.259200 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259185    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy"
Jul 03 10:28:38.259449 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259243    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy"
Jul 03 10:28:38.259449 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259251    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="193d8763-136f-483c-ab09-2fb9555ee967" containerName="istio-proxy"
Jul 03 10:28:38.259449 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259263    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d62728-3f70-48d6-904b-558f4a067a2a" containerName="main"
Jul 03 10:28:38.259449 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.259270    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ef778c-3925-4fb1-a966-23391004d288" containerName="maas-api"
Jul 03 10:28:38.262529 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.262508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.264942 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.264921    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sldrw\"/\"openshift-service-ca.crt\""
Jul 03 10:28:38.265715 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.265685    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sldrw\"/\"default-dockercfg-2snr6\""
Jul 03 10:28:38.265909 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.265701    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sldrw\"/\"kube-root-ca.crt\""
Jul 03 10:28:38.272074 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.272048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"]
Jul 03 10:28:38.364423 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.364388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx7nb\" (UniqueName: \"kubernetes.io/projected/a51524fb-de71-4032-85c3-face4c0972c6-kube-api-access-rx7nb\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.364564 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.364431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-sys\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.364564 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.364447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-proc\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.364564 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.364512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-lib-modules\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.364687 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.364574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-podres\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.465814 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.465782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx7nb\" (UniqueName: \"kubernetes.io/projected/a51524fb-de71-4032-85c3-face4c0972c6-kube-api-access-rx7nb\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.465946 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.465822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-sys\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.465946 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.465838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-proc\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.465946 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.465862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-lib-modules\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.465946 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.465913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-podres\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.465946 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.465927    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-sys\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.466104 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.465994    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-lib-modules\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.466104 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.466004    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-proc\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.466104 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.466030    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a51524fb-de71-4032-85c3-face4c0972c6-podres\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.481542 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.481518    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx7nb\" (UniqueName: \"kubernetes.io/projected/a51524fb-de71-4032-85c3-face4c0972c6-kube-api-access-rx7nb\") pod \"perf-node-gather-daemonset-jznt2\" (UID: \"a51524fb-de71-4032-85c3-face4c0972c6\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.574387 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.574292    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:38.716316 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.716291    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"]
Jul 03 10:28:38.718020 ip-10-0-138-110 kubenswrapper[2580]: W0703 10:28:38.717987    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda51524fb_de71_4032_85c3_face4c0972c6.slice/crio-2a1a936426b177c4057b349cb2808fca44cccd4e4c05e5588b708e963ec1f568 WatchSource:0}: Error finding container 2a1a936426b177c4057b349cb2808fca44cccd4e4c05e5588b708e963ec1f568: Status 404 returned error can't find the container with id 2a1a936426b177c4057b349cb2808fca44cccd4e4c05e5588b708e963ec1f568
Jul 03 10:28:38.728011 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:38.727988    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-bs5kx_12e54a59-313c-4e8e-b56b-a9a4aed3be8b/networking-console-plugin/0.log"
Jul 03 10:28:39.020399 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:39.020365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2" event={"ID":"a51524fb-de71-4032-85c3-face4c0972c6","Type":"ContainerStarted","Data":"73edc15f30698f88a0d0ec29b80bb75965d65731a376687f426112308bf9520e"}
Jul 03 10:28:39.020602 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:39.020416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2" event={"ID":"a51524fb-de71-4032-85c3-face4c0972c6","Type":"ContainerStarted","Data":"2a1a936426b177c4057b349cb2808fca44cccd4e4c05e5588b708e963ec1f568"}
Jul 03 10:28:39.020602 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:39.020458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:39.037844 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:39.037804    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2" podStartSLOduration=1.037789077 podStartE2EDuration="1.037789077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 10:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:28:39.03667728 +0000 UTC m=+2723.205152692" watchObservedRunningTime="2026-07-03 10:28:39.037789077 +0000 UTC m=+2723.206264478"
Jul 03 10:28:39.953725 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:39.953693    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-6f9lm_c679a260-f650-4d55-8af5-080c507e3232/download-server/0.log"
Jul 03 10:28:41.763178 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:41.763145    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whxmx_cd9d1bfd-444a-4357-b5af-2c8ad6e0af57/dns/0.log"
Jul 03 10:28:41.784268 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:41.784245    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whxmx_cd9d1bfd-444a-4357-b5af-2c8ad6e0af57/kube-rbac-proxy/0.log"
Jul 03 10:28:41.855371 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:41.855346    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwcx7_7b7191e6-3c30-4786-a757-291e3a630ae7/dns-node-resolver/0.log"
Jul 03 10:28:42.446092 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:42.446068    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x8wnj_96389e34-4e65-414b-9ab5-7fdba62634ad/node-ca/0.log"
Jul 03 10:28:43.494947 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:43.494916    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678zm9hx_2d84fba9-755b-4957-951f-b9630727633f/istio-proxy/0.log"
Jul 03 10:28:43.638026 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:43.637987    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lx62t_9c77c2aa-4569-44ed-9916-3d738740089a/discovery/0.log"
Jul 03 10:28:43.833782 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:43.833725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kkr7c_de6477f5-aa6e-4053-a42d-0d7a29c0818c/payload-processing/0.log"
Jul 03 10:28:44.613470 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:44.613440    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jtcvp_903f85b0-1190-487a-87db-8ef46a6bd144/serve-healthcheck-canary/0.log"
Jul 03 10:28:45.034979 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:45.034952    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-jznt2"
Jul 03 10:28:45.247584 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:45.247555    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8g4vq_f6f1b368-dc3a-49be-9757-d865d5534a2a/kube-rbac-proxy/0.log"
Jul 03 10:28:45.272457 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:45.272435    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8g4vq_f6f1b368-dc3a-49be-9757-d865d5534a2a/exporter/0.log"
Jul 03 10:28:45.297125 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:45.297058    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8g4vq_f6f1b368-dc3a-49be-9757-d865d5534a2a/extractor/0.log"
Jul 03 10:28:48.104449 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:48.104414    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74cfb6d5d8-j6b9t_d0277d5e-3316-4d03-a7b5-83bcd4a274c5/manager/0.log"
Jul 03 10:28:48.418389 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:48.418354    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f66d7cdc8-zc4md_db25c703-90b1-4b62-b5e6-266bec99b347/manager/0.log"
Jul 03 10:28:48.438366 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:48.438334    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f66d7cdc8-zc4md_db25c703-90b1-4b62-b5e6-266bec99b347/copy-manifests/0.log"
Jul 03 10:28:49.200717 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:49.200688    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678zm9hx_2d84fba9-755b-4957-951f-b9630727633f/istio-proxy/0.log"
Jul 03 10:28:49.310480 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:49.310445    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lx62t_9c77c2aa-4569-44ed-9916-3d738740089a/discovery/0.log"
Jul 03 10:28:49.455718 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:49.455623    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kkr7c_de6477f5-aa6e-4053-a42d-0d7a29c0818c/payload-processing/0.log"
Jul 03 10:28:49.835772 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:49.835746    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75576cf7dd-6m9mb_d787fdf6-eef3-4b67-88dc-331c8541a8cd/manager/0.log"
Jul 03 10:28:49.899812 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:49.899766    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4hzft_b3eba850-ba9b-4e51-80e8-04180e8fff9f/openshift-lws-operator/0.log"
Jul 03 10:28:50.673425 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:50.673393    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678zm9hx_2d84fba9-755b-4957-951f-b9630727633f/istio-proxy/0.log"
Jul 03 10:28:50.780469 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:50.780435    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lx62t_9c77c2aa-4569-44ed-9916-3d738740089a/discovery/0.log"
Jul 03 10:28:50.917204 ip-10-0-138-110 kubenswrapper[2580]: I0703 10:28:50.917171    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-kkr7c_de6477f5-aa6e-4053-a42d-0d7a29c0818c/payload-processing/0.log"