Jul 02 17:08:30.836444 ip-10-0-133-98 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 17:08:30.836455 ip-10-0-133-98 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 17:08:30.836462 ip-10-0-133-98 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 17:08:30.836692 ip-10-0-133-98 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 17:08:40.840047 ip-10-0-133-98 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 17:08:40.840065 ip-10-0-133-98 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 17e2b19083dd453c899745ac17037f34 --
Jul 02 17:10:44.884903 ip-10-0-133-98 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 17:10:45.308639 ip-10-0-133-98 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 17:10:45.308639 ip-10-0-133-98 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 17:10:45.308639 ip-10-0-133-98 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 17:10:45.308639 ip-10-0-133-98 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 17:10:45.308639 ip-10-0-133-98 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 17:10:45.311030 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.310941    2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 17:10:45.317719 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317702    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.317719 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317720    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317724    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317728    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317731    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317734    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317738    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317741    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317744    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317747    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317749    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317752    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317755    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317758    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317762    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317764    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317767    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317770    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317772    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317775    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317778    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.317787 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317793    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317797    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317799    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317804    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317808    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317811    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317813    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317816    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317819    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317822    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317825    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317827    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317830    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317833    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317836    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317838    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317843    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317847    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.318249 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317851    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317855    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317858    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317861    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317863    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317866    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317868    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317871    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317873    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317875    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317878    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317880    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317882    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317885    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317887    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317890    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317894    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317896    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317899    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317902    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.318680 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317904    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317907    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317911    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317914    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317916    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317919    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317921    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317924    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317926    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317929    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317932    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317935    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317938    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317940    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317942    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317945    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317947    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317950    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317952    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317954    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.319141 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317957    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317959    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317962    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317964    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317967    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317969    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317971    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317975    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317978    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317981    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317983    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317986    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317988    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317990    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317993    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317996    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.317998    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318001    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318003    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.319608 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318005    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318837    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318853    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318858    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318861    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318864    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318867    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318870    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318873    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318876    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318879    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318882    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318885    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318887    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318890    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318893    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318896    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318898    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318902    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.320077 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318906    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318909    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318912    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318914    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318917    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318920    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318923    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318925    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318928    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318930    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318933    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318935    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318938    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318940    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318943    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318947    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318950    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318953    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318955    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318958    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.320544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318960    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318963    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318965    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318968    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318970    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318973    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318975    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318978    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318981    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318984    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318986    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318988    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318991    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318994    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318996    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.318999    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319001    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319004    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319006    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319008    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.321031 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319011    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319014    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319016    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319018    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319021    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319023    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319027    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319030    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319033    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319036    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319039    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319041    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319044    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319047    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319051    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319053    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319056    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319058    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319061    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.321498 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319063    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319065    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319068    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319071    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319073    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319075    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319078    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319080    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319083    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319086    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319088    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319091    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319093    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319096    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319098    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319102    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319105    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319108    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319111    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.321962 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319114    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319118    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319121    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319556    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319563    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319566    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319569    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319572    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319575    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319578    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319581    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319584    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319586    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319605    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319608    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319611    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319614    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319617    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319620    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319623    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.322416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319626    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319628    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319631    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319633    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319636    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319640    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319642    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319645    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319647    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319650    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319653    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319657    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319661    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319664    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319667    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319671    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319675    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319678    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319681    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.322902 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319684    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319687    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319690    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319692    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319696    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319699    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319701    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319703    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319707    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319709    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319712    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319715    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319717    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319720    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319722    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319725    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319727    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319730    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319732    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319735    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.323351 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319737    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319740    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319742    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319745    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319749    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319752    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319755    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319758    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319760    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319764    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319767    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319769    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319772    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319776    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319780    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319783    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319786    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319788    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319791    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.323846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319793    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319796    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319798    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319801    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319803    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319806    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319808    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319811    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319813    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319816    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319818    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319821    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319823    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319826    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319829    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319832    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319834    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319837    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319839    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319842    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.324287 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319845    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319848    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319850    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.319853    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319928    2550 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319935    2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319942    2550 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319947    2550 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319951    2550 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319954    2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319958    2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319963    2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319966    2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319969    2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319973    2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319976    2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319979    2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319982    2550 flags.go:64] FLAG: --cgroup-root=""
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319988    2550 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319991    2550 flags.go:64] FLAG: --client-ca-file=""
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319994    2550 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.319997    2550 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320001    2550 flags.go:64] FLAG: --cluster-domain=""
Jul 02 17:10:45.324798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320004    2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320007    2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320010    2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320014    2550 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320017    2550 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320020    2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320023    2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320027    2550 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320030    2550 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320033    2550 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320036    2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320039    2550 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320042    2550 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320046    2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320049    2550 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320055    2550 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320058    2550 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320062    2550 flags.go:64] FLAG: --enable-server="true"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320065    2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320070    2550 flags.go:64] FLAG: --event-burst="100"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320073    2550 flags.go:64] FLAG: --event-qps="50"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320076    2550 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320079    2550 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320082    2550 flags.go:64] FLAG: --eviction-hard=""
Jul 02 17:10:45.325329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320086    2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320089    2550 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320092    2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320097    2550 flags.go:64] FLAG: --eviction-soft=""
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320099    2550 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320102    2550 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320105    2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320109    2550 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320111    2550 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320114    2550 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320117    2550 flags.go:64] FLAG: --feature-gates=""
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320121    2550 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320124    2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320128    2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320131    2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320134    2550 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320137    2550 flags.go:64] FLAG: --help="false"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320139    2550 flags.go:64] FLAG: --hostname-override="ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320143    2550 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320145    2550 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320148    2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320152    2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320156    2550 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320159    2550 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 17:10:45.325898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320162    2550 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320165    2550 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320167    2550 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320170    2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320173    2550 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320176    2550 flags.go:64] FLAG: --kube-reserved=""
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320179    2550 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320181    2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320184    2550 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320187    2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320190    2550 flags.go:64] FLAG: --lock-file=""
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320194    2550 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320197    2550 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320200    2550 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320206    2550 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320208    2550 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320211    2550 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320214    2550 flags.go:64] FLAG: --logging-format="text"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320217    2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320220    2550 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320223    2550 flags.go:64] FLAG: --manifest-url=""
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320226    2550 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320233    2550 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320236    2550 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320241    2550 flags.go:64] FLAG: --max-pods="110"
Jul 02 17:10:45.326506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320244    2550 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320247    2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320250    2550 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320253    2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320256    2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320258    2550 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320262    2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320269    2550 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320272    2550 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320275    2550 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320278    2550 flags.go:64] FLAG: --pod-cidr=""
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320281    2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320286    2550 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320289    2550 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320292    2550 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320295    2550 flags.go:64] FLAG: --port="10250"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320298    2550 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320301    2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bec83891c7b1b069"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320306    2550 flags.go:64] FLAG: --qos-reserved=""
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320309    2550 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320311    2550 flags.go:64] FLAG: --register-node="true"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320316    2550 flags.go:64] FLAG: --register-with-taints=""
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320319    2550 flags.go:64] FLAG: --registry-burst="10"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320322    2550 flags.go:64] FLAG: --registry-qps="5"
Jul 02 17:10:45.327588 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320325    2550 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320328    2550 flags.go:64] FLAG: --reserved-memory=""
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320332    2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320335    2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320338    2550 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320341    2550 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320344    2550 flags.go:64] FLAG: --runonce="false"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320346    2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320349    2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320352    2550 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320355    2550 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320358    2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320361    2550 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320364    2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320367    2550 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320370    2550 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320373    2550 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320376    2550 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320378    2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320382    2550 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320384    2550 flags.go:64] FLAG: --system-cgroups=""
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320387    2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320392    2550 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320395    2550 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320397    2550 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 17:10:45.328648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320401    2550 flags.go:64] FLAG: --tls-min-version=""
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320405    2550 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320408    2550 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320411    2550 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320415    2550 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320418    2550 flags.go:64] FLAG: --v="2"
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320423    2550 flags.go:64] FLAG: --version="false"
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320427    2550 flags.go:64] FLAG: --vmodule=""
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320431    2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.320434    2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320553    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320558    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320561    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320563    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320566    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320569    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320573    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320577    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320580    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320582    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320585    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.329769 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320587    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320603    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320607    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320610    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320613    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320616    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320618    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320621    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320624    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320626    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320629    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320631    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320635    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320638    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320641    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320645    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320647    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320650    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320652    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320655    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.330499 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320658    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320660    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320663    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320665    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320668    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320670    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320673    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320675    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320678    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320680    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320683    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320686    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320688    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320691    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320693    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320696    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320699    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320701    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320704    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320706    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.331033 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320709    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320712    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320714    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320717    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320720    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320723    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320726    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320729    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320732    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320736    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320739    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320742    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320745    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320748    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320750    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320753    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320757    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320760    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320763    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.331616 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320766    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320769    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320772    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320775    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320778    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320780    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320783    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320786    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320789    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320792    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320794    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320797    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320800    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320802    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320804    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320807    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320809    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320813    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320816    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320818    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.332391 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320822    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320825    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320828    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320830    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320833    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320835    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320838    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320841    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.320843    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.321499    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.328850    2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.328873    2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.328901    2550 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.328910    2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 17:10:45.333200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.328995    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329003    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329009    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329013    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329018    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329022    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329027    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329031    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329036    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329040    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329045    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329049    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329053    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329057    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329062    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329066    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329070    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329074    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329078    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329083    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.333544 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329087    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329092    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329097    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329101    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329106    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329110    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329116    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329121    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329126    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329131    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329135    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329140    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329144    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329148    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329152    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329157    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329161    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329165    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329169    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329173    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.334331 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329177    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329181    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329185    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329189    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329193    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329198    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329202    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329206    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329210    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329214    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329219    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329223    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329226    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329231    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329235    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329239    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329243    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329247    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329251    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.334848 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329256    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329260    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329265    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329270    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329274    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329278    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329282    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329287    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329290    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329294    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329299    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329303    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329310    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329315    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329319    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329324    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329327    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329331    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329336    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.335366 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329340    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329344    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329348    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329352    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329356    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329361    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329365    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329369    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329374    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329378    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329383    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329387    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329392    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329398    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329404    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329410    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329415    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329420    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329424    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329428    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.335846 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329432    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.329440    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329635    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329643    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329648    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329652    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329657    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329661    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329666    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329670    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329674    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329678    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329683    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329687    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 17:10:45.336348 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329691    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329696    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329700    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329704    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329711    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329716    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329721    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329725    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329729    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329733    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329738    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329743    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329747    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329751    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329756    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329760    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329765    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329771    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329776    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 17:10:45.336704 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329781    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329787    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329792    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329797    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329801    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329806    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329811    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329815    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329819    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329824    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329828    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329832    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329836    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329840    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329844    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329849    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329854    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329858    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329862    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 17:10:45.337144 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329866    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329870    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329874    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329878    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329883    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329887    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329891    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329895    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329900    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329904    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329908    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329913    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329917    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329921    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329925    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329929    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329933    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329937    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329941    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329946    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 17:10:45.337683 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329950    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329954    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329958    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329963    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329966    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329971    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329975    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329980    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329985    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329989    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329993    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.329997    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330001    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330005    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330009    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330013    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330018    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330022    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330026    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330030    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 17:10:45.338219 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330035    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330039    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330043    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330047    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330052    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330056    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330061    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330065    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:45.330069    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.330078    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.331078    2550 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.333670    2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.335220    2550 server.go:1019] "Starting client certificate rotation"
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.335331    2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 17:10:45.338922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.335371    2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 17:10:45.340574 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.340555    2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 17:10:45.342036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.342011    2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 17:10:45.349800 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.349783    2550 log.go:25] "Validated CRI v1 runtime API"
Jul 02 17:10:45.351733 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.351717    2550 log.go:25] "Validated CRI v1 image API"
Jul 02 17:10:45.352552 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.352537    2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 17:10:45.355030 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.355012    2550 fs.go:135] Filesystem UUIDs: map[54d91f0e-3d19-4b66-bca5-1e0292ab1543:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 eb09ba9a-c8eb-42fc-8cc8-3da6877f6cca:/dev/nvme0n1p3]
Jul 02 17:10:45.355084 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.355030    2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 17:10:45.360981 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.360861    2550 manager.go:216] Machine: {Timestamp:2026-07-02 17:10:45.358622084 +0000 UTC m=+0.349582342 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100117 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec229b9be4df19eb20d0ce1731ae9522 SystemUUID:ec229b9b-e4df-19eb-20d0-ce1731ae9522 BootID:17e2b190-83dd-453c-8997-45ac17037f34 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:d0:8c:17:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:d0:8c:17:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:ea:48:65:df:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 17:10:45.360981 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.360974    2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 17:10:45.361103 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.361056    2550 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 17:10:45.362996 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.362963    2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 17:10:45.363130 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.362997    2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 17:10:45.363740 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.363730    2550 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 17:10:45.363772 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.363743    2550 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 17:10:45.363772 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.363751    2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 17:10:45.364351 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.364342    2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 17:10:45.364462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.364448    2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 17:10:45.365053 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.365043    2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 17:10:45.367992 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.367981    2550 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 17:10:45.368101 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.368092    2550 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 17:10:45.368139 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.368120    2550 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 17:10:45.368139 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.368129    2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 17:10:45.368193 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.368143    2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 17:10:45.368193 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.368153    2550 kubelet.go:398] "Adding apiserver pod source"
Jul 02 17:10:45.368193 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.368161    2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 17:10:45.368467 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.368457    2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 17:10:45.368512 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.368474    2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 17:10:45.370631 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.370428    2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 17:10:45.372607 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.372383    2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 17:10:45.372676 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.372643    2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 17:10:45.373263 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373252    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 17:10:45.373303 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373269    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 17:10:45.373303 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373274    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 17:10:45.373303 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373280    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 17:10:45.373303 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373288    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 17:10:45.373303 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373294    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 17:10:45.373422 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373399    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 17:10:45.373422 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373405    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 17:10:45.373422 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373412    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 17:10:45.373422 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373418    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 17:10:45.373550 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373426    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 17:10:45.373550 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.373434    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 17:10:45.374145 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.374136    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 17:10:45.374145 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.374145    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 17:10:45.377512 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.377498    2550 server.go:1268] "Started kubelet"
Jul 02 17:10:45.377646 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.377586    2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 17:10:45.377702 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.377637    2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 17:10:45.377702 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.377671    2550 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 17:10:45.378315 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.378293    2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 17:10:45.378397 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.378348    2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 17:10:45.378397 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.378372    2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 17:10:45.378449 ip-10-0-133-98 systemd[1]: Started Kubernetes Kubelet.
Jul 02 17:10:45.379039 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.378786    2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 17:10:45.379144 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.379132    2550 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 17:10:45.384716 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.384696    2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 17:10:45.385265 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.385252    2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 17:10:45.385326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.385264    2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 17:10:45.385383 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.385334    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:45.386041 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.385928    2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 17:10:45.386041 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.385930    2550 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 17:10:45.386041 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.385971    2550 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 17:10:45.386216 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.386053    2550 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 17:10:45.386216 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.386062    2550 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 17:10:45.387650 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.387626    2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4r9d"
Jul 02 17:10:45.388395 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.388380    2550 factory.go:55] Registering systemd factory
Jul 02 17:10:45.388395 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.388397    2550 factory.go:223] Registration of the systemd container factory successfully
Jul 02 17:10:45.388513 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.387266    2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-98.ec2.internal.18be8830bbe54916  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-98.ec2.internal,UID:ip-10-0-133-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-98.ec2.internal,},FirstTimestamp:2026-07-02 17:10:45.377468694 +0000 UTC m=+0.368428971,LastTimestamp:2026-07-02 17:10:45.377468694 +0000 UTC m=+0.368428971,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-98.ec2.internal,}"
Jul 02 17:10:45.388619 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.388606    2550 factory.go:153] Registering CRI-O factory
Jul 02 17:10:45.388669 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.388621    2550 factory.go:223] Registration of the crio container factory successfully
Jul 02 17:10:45.388724 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.388672    2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 17:10:45.388724 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.388696    2550 factory.go:103] Registering Raw factory
Jul 02 17:10:45.388724 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.388707    2550 manager.go:1196] Started watching for new ooms in manager
Jul 02 17:10:45.389456 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.389278    2550 manager.go:349] Starting recovery of all containers
Jul 02 17:10:45.391208 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.391183    2550 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 17:10:45.391503 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.391462    2550 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 17:10:45.393778 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.393729    2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 17:10:45.397229 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.397067    2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4r9d"
Jul 02 17:10:45.403311 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.403293    2550 manager.go:354] Recovery completed
Jul 02 17:10:45.407440 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.407424    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.409695 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.409679    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.409765 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.409711    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.409765 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.409724    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.410268 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.410253    2550 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 17:10:45.410268 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.410266    2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 17:10:45.410370 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.410278    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.410370 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.410284    2550 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 17:10:45.411003 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.410985    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.411083 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.411014    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.411083 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.411027    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.411419 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.411401    2550 policy_none.go:49] "None policy: Start"
Jul 02 17:10:45.411513 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.411425    2550 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 17:10:45.411513 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.411438    2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 17:10:45.411663 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.411550    2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-98.ec2.internal.18be8830bdd10836  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-98.ec2.internal,UID:ip-10-0-133-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-98.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-98.ec2.internal,},FirstTimestamp:2026-07-02 17:10:45.409695798 +0000 UTC m=+0.400656043,LastTimestamp:2026-07-02 17:10:45.409695798 +0000 UTC m=+0.400656043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-98.ec2.internal,}"
Jul 02 17:10:45.412743 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.412731    2550 policy_none.go:47] "Start"
Jul 02 17:10:45.447829 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.447806    2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 17:10:45.452865 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.447854    2550 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 17:10:45.452865 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.447880    2550 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 17:10:45.452865 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.447911    2550 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 02 17:10:45.452865 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.450514    2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:45.453226 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.453214    2550 manager.go:337] "Starting Device Plugin manager"
Jul 02 17:10:45.453264 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.453254    2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 17:10:45.453310 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.453265    2550 server.go:87] "Starting device plugin registration server"
Jul 02 17:10:45.453557 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.453545    2550 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 17:10:45.453635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.453558    2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 17:10:45.453678 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.453656    2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 17:10:45.453764 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.453751    2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 17:10:45.453806 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.453766    2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 17:10:45.454397 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.454377    2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 17:10:45.454485 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.454425    2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:45.549023 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.548976    2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"]
Jul 02 17:10:45.549184 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.549075    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.550673 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.550650    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.550780 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.550683    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.550780 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.550693    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.552061 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.552047    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.552193 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.552176    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.552237 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.552215    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.552988 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.552972    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.552988 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.552981    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.553136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.553000    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.553136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.553005    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.553136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.553010    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.553136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.553019    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.553892 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.553879    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.554172 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554157    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.554213 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554189    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 17:10:45.554630 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554607    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.554710 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554643    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.554710 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554657    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.554710 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554682    2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.554975 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554957    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 17:10:45.555036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554982    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 17:10:45.555036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.554991    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeHasSufficientPID"
Jul 02 17:10:45.570817 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.570796    2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.570892 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.570818    2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-98.ec2.internal\": node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:45.584297 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.584271    2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-98.ec2.internal\" not found" node="ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.586911 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.586893    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8af002de85c52f61eae8d9d440ef017d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-98.ec2.internal\" (UID: \"8af002de85c52f61eae8d9d440ef017d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.587011 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.586923    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41ad76e29acdf1dd373255071bc14d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal\" (UID: \"b41ad76e29acdf1dd373255071bc14d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.587011 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.586950    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41ad76e29acdf1dd373255071bc14d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal\" (UID: \"b41ad76e29acdf1dd373255071bc14d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.588859 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.588845    2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-98.ec2.internal\" not found" node="ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.598127 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.598112    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:45.687757 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.687733    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8af002de85c52f61eae8d9d440ef017d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-98.ec2.internal\" (UID: \"8af002de85c52f61eae8d9d440ef017d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.687876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.687763    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41ad76e29acdf1dd373255071bc14d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal\" (UID: \"b41ad76e29acdf1dd373255071bc14d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.687876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.687780    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41ad76e29acdf1dd373255071bc14d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal\" (UID: \"b41ad76e29acdf1dd373255071bc14d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.687876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.687818    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8af002de85c52f61eae8d9d440ef017d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-98.ec2.internal\" (UID: \"8af002de85c52f61eae8d9d440ef017d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.687876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.687838    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41ad76e29acdf1dd373255071bc14d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal\" (UID: \"b41ad76e29acdf1dd373255071bc14d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.687876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.687806    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41ad76e29acdf1dd373255071bc14d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal\" (UID: \"b41ad76e29acdf1dd373255071bc14d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.699180 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.699160    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:45.799239 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.799209    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:45.887983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.887925    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.892426 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:45.892404    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:45.899561 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:45.899541    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:46.000164 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.000119    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:46.100660 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.100626    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:46.201284 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.201202    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:46.301742 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.301707    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-98.ec2.internal\" not found"
Jul 02 17:10:46.334915 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.334876    2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 17:10:46.335436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.335073    2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 17:10:46.359220 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.359192    2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:46.369272 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.369251    2550 apiserver.go:52] "Watching apiserver"
Jul 02 17:10:46.380003 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.379782    2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 17:10:46.381319 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.380640    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8npvm","openshift-ovn-kubernetes/ovnkube-node-g6cxx","kube-system/global-pull-secret-syncer-j9gxg","openshift-cluster-node-tuning-operator/tuned-vsqvj","openshift-image-registry/node-ca-9gjcr","openshift-multus/multus-additional-cni-plugins-d7d8c","openshift-multus/multus-jq6vz","openshift-network-diagnostics/network-check-target-nl2sk","openshift-network-operator/iptables-alerter-sbt9k","kube-system/konnectivity-agent-kdmx6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5","openshift-dns/node-resolver-kmsf9"]
Jul 02 17:10:46.382577 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.382558    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:46.382700 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.382677    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:10:46.383922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.383909    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.385070 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.385048    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.385165 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.385116    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:10:46.386141 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.386114    2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:46.386262 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.386245    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.386321 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.386118    2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 17:10:46.387407 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.387392    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.388575 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.388560    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.389586 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.389573    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.390663 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.390651    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:46.390717 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.390705    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:10:46.391842 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.391827    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-systemd\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.391899 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.391854    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-var-lib-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.391899 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.391868    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.391973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.391900    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.391973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.391936    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovn-node-metrics-cert\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392068 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.391969    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysctl-d\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392068 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392008    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-run\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392068 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392038    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-log-socket\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392068 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392065    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.392244 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392091    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-var-lib-kubelet\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392244 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392139    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysctl-conf\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392244 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392174    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-systemd\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392244 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392199    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-tmp\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392244 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392233    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysconfig\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392264    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-run-netns\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392288    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-node-log\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392308    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovnkube-config\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392327    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovnkube-script-lib\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392352    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-kubernetes\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392368    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-host\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392383    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392399    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-slash\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392435    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-cni-bin\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392457    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-cni-netd\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392472    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-tuned\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392494    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-ovn\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392530    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-lib-modules\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392559    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xznm6\" (UniqueName: \"kubernetes.io/projected/19f0cb34-ac3a-4521-bc54-c453c6db705c-kube-api-access-xznm6\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392578    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-kubelet\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392608    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-env-overrides\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392634    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shtjj\" (UniqueName: \"kubernetes.io/projected/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-kube-api-access-shtjj\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392661    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f43ef34-2095-452e-9da1-b557b4ac5d11-dbus\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392676    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-sys\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392702    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcw2j\" (UniqueName: \"kubernetes.io/projected/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-kube-api-access-rcw2j\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392717    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f43ef34-2095-452e-9da1-b557b4ac5d11-kubelet-config\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392730    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-modprobe-d\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392755    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-etc-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392773    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.392797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392789    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.393347 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.392806    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-systemd-units\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.393347 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.393294    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:10:46.394800 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.394784    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.396036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.396019    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.396125 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.396036    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.396212 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.396190    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.396212 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.396206    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.396345 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.396265    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 17:10:46.401700 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.401675    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 17:05:45 +0000 UTC" deadline="2027-12-05 09:52:39.47447628 +0000 UTC"
Jul 02 17:10:46.401700 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.401698    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12496h41m53.07278086s"
Jul 02 17:10:46.410162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.410143    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 17:10:46.410273 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.410186    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 17:10:46.410495 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.410476    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.410627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.410505    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 17:10:46.410794 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.410776    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kp6n2\""
Jul 02 17:10:46.411069 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411049    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8bn7z\""
Jul 02 17:10:46.411162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411086    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 17:10:46.411162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411154    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 17:10:46.411372 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411355    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.411465 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411389    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 17:10:46.411465 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411395    2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:46.411566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411475    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.411566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411509    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.411566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411518    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.411566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411527    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 17:10:46.411842 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411604    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.411842 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411480    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.411933 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411844    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.411933 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.411900    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tshjw\""
Jul 02 17:10:46.412375 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.412226    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-862jn\""
Jul 02 17:10:46.412434 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.412400    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2qcf4\""
Jul 02 17:10:46.412687 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.412603    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lpbjg\""
Jul 02 17:10:46.412687 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.412639    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 17:10:46.412835 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.412707    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 17:10:46.412835 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.412773    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.413294 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.413102    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6jk7w\""
Jul 02 17:10:46.413294 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.413129    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 17:10:46.413294 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.413158    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 17:10:46.413294 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.413166    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 17:10:46.413294 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.413236    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zc567\""
Jul 02 17:10:46.413670 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.413366    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t4w6d\""
Jul 02 17:10:46.413670 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.413527    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 17:10:46.414210 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.414193    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 17:10:46.422411 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.422387    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal"]
Jul 02 17:10:46.432052 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.431970    2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 17:10:46.432215 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.432097    2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"
Jul 02 17:10:46.434853 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.434836    2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 17:10:46.468932 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.468745    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal"]
Jul 02 17:10:46.475537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.475517    2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 17:10:46.486957 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.486938    2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 17:10:46.493056 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493037    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fczgp\" (UniqueName: \"kubernetes.io/projected/f42b5fdf-69ac-4ce7-bf53-425516d05f89-kube-api-access-fczgp\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.493159 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493062    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c043f0f2-4d45-4e44-859d-9666290b402a-multus-daemon-config\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.493159 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493078    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smg2q\" (UniqueName: \"kubernetes.io/projected/1edae93b-ecb6-40fc-91a1-5ef01b981e95-kube-api-access-smg2q\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.493159 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493101    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysctl-conf\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.493159 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493134    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cnibin\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.493353 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493217    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-socket-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.493353 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493244    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysctl-conf\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.493353 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493261    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysconfig\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.493353 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493289    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-run-netns\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.493353 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493315    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovnkube-config\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.493353 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493340    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-run-netns\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493342    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovnkube-script-lib\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493407    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-kubernetes\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493430    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493356    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysconfig\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493454    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493473    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/499a1f52-1802-42a4-b958-40b25212a692-tmp-dir\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493490    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-slash\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493511    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-tuned\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493510    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-kubernetes\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493544    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-lib-modules\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.493568    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:46.493627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493581    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-slash\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493610    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-os-release\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.493678    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:10:46.993653047 +0000 UTC m=+1.984613300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493695    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-conf-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493716    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-registration-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493721    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-lib-modules\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493741    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493769    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-kubelet\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493792    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-env-overrides\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493816    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-sys\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493807    2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493844    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcw2j\" (UniqueName: \"kubernetes.io/projected/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-kube-api-access-rcw2j\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493868    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-multus-certs\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493891    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-device-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493917    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-modprobe-d\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493934    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovnkube-config\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493943    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493952    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-kubelet\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.493969    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-hostroot\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494006    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovnkube-script-lib\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494090    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqwg2\" (UniqueName: \"kubernetes.io/projected/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-kube-api-access-zqwg2\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494135    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-sys\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494126    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494152    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7b0c1a6-6262-4585-8a01-541a8a412bcc-host-slash\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494197    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-var-lib-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494218    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-env-overrides\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494266    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-modprobe-d\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494275    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-run\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494257    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-var-lib-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494322    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494348    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-system-cni-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494357    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-run\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494377    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.494983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494406    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-etc-kubernetes\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494438    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-systemd\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494465    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-tmp\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494496    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-system-cni-dir\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494518    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-systemd\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494526    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.494529    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494552    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c043f0f2-4d45-4e44-859d-9666290b402a-cni-binary-copy\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494573    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-socket-dir-parent\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.494614    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret podName:1f43ef34-2095-452e-9da1-b557b4ac5d11 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:46.994582146 +0000 UTC m=+1.985542381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret") pod "global-pull-secret-syncer-j9gxg" (UID: "1f43ef34-2095-452e-9da1-b557b4ac5d11") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494635    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/309ddb97-fafb-42f2-b000-197b4c371c6c-konnectivity-ca\") pod \"konnectivity-agent-kdmx6\" (UID: \"309ddb97-fafb-42f2-b000-197b4c371c6c\") " pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494660    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-node-log\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494678    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-host\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494717    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-node-log\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494760    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-netns\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494785    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-kubelet\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494810    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.495759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494822    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-host\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494838    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-sys-fs\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494882    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1edae93b-ecb6-40fc-91a1-5ef01b981e95-host\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494909    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-cni-bin\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494933    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-cni-netd\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494957    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-cni-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.494980    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1edae93b-ecb6-40fc-91a1-5ef01b981e95-serviceca\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495001    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-ovn\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495029    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-cni-bin\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495031    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xznm6\" (UniqueName: \"kubernetes.io/projected/19f0cb34-ac3a-4521-bc54-c453c6db705c-kube-api-access-xznm6\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495066    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-ovn\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495077    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-cni-netd\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495082    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-cni-bin\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495119    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495150    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbszv\" (UniqueName: \"kubernetes.io/projected/499a1f52-1802-42a4-b958-40b25212a692-kube-api-access-nbszv\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495204    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shtjj\" (UniqueName: \"kubernetes.io/projected/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-kube-api-access-shtjj\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495232    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f43ef34-2095-452e-9da1-b557b4ac5d11-dbus\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.496537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495262    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495301    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-cni-multus\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495309    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f43ef34-2095-452e-9da1-b557b4ac5d11-dbus\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495335    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddq9k\" (UniqueName: \"kubernetes.io/projected/c043f0f2-4d45-4e44-859d-9666290b402a-kube-api-access-ddq9k\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495390    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/309ddb97-fafb-42f2-b000-197b4c371c6c-agent-certs\") pod \"konnectivity-agent-kdmx6\" (UID: \"309ddb97-fafb-42f2-b000-197b4c371c6c\") " pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495421    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f43ef34-2095-452e-9da1-b557b4ac5d11-kubelet-config\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495486    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f43ef34-2095-452e-9da1-b557b4ac5d11-kubelet-config\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495488    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-etc-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495529    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495537    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-etc-openvswitch\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495556    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-cnibin\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495586    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-os-release\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495619    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495623    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7b0c1a6-6262-4585-8a01-541a8a412bcc-iptables-alerter-script\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495662    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-systemd-units\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495686    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-systemd\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495715    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-systemd-units\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495726    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-run-systemd\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495734    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495755    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495761    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovn-node-metrics-cert\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495786    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysctl-d\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495813    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-k8s-cni-cncf-io\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495864    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqmxc\" (UniqueName: \"kubernetes.io/projected/b7b0c1a6-6262-4585-8a01-541a8a412bcc-kube-api-access-qqmxc\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495889    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/499a1f52-1802-42a4-b958-40b25212a692-hosts-file\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495916    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-log-socket\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.495942    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-var-lib-kubelet\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.496040    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-var-lib-kubelet\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.496086    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-sysctl-d\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.496092    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-log-socket\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.497003    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-tmp\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.497798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.497117    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-etc-tuned\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.498388 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.497992    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-ovn-node-metrics-cert\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.510367 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.510344    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcw2j\" (UniqueName: \"kubernetes.io/projected/84c3eb08-f6ac-4c85-abf4-998b19bd0e5b-kube-api-access-rcw2j\") pod \"tuned-vsqvj\" (UID: \"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b\") " pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.510632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.510615    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shtjj\" (UniqueName: \"kubernetes.io/projected/fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c-kube-api-access-shtjj\") pod \"ovnkube-node-g6cxx\" (UID: \"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.511659 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.511642    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xznm6\" (UniqueName: \"kubernetes.io/projected/19f0cb34-ac3a-4521-bc54-c453c6db705c-kube-api-access-xznm6\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:46.514753 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.514734    2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-th7pk"
Jul 02 17:10:46.538723 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.538696    2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-th7pk"
Jul 02 17:10:46.539316 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.539282    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41ad76e29acdf1dd373255071bc14d7.slice/crio-4912f928486a8ef0dd2b8279ccbcccf2e6cc90c6f4c73dd55b8bbe2a89e58857 WatchSource:0}: Error finding container 4912f928486a8ef0dd2b8279ccbcccf2e6cc90c6f4c73dd55b8bbe2a89e58857: Status 404 returned error can't find the container with id 4912f928486a8ef0dd2b8279ccbcccf2e6cc90c6f4c73dd55b8bbe2a89e58857
Jul 02 17:10:46.539892 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.539826    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af002de85c52f61eae8d9d440ef017d.slice/crio-e1799452c928c5bf33d4c0bf0e1d430be0d091a5ccb97d1354f7110c5df3c429 WatchSource:0}: Error finding container e1799452c928c5bf33d4c0bf0e1d430be0d091a5ccb97d1354f7110c5df3c429: Status 404 returned error can't find the container with id e1799452c928c5bf33d4c0bf0e1d430be0d091a5ccb97d1354f7110c5df3c429
Jul 02 17:10:46.543011 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.542991    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:10:46.597210 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597176    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.597210 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597207    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-sys-fs\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597226    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1edae93b-ecb6-40fc-91a1-5ef01b981e95-host\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597243    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-cni-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597310    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-cni-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597329    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1edae93b-ecb6-40fc-91a1-5ef01b981e95-host\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597330    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597318    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-sys-fs\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597351    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1edae93b-ecb6-40fc-91a1-5ef01b981e95-serviceca\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597430    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-cni-bin\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597448    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597485    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-cni-bin\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597527    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-etc-selinux\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597538    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbszv\" (UniqueName: \"kubernetes.io/projected/499a1f52-1802-42a4-b958-40b25212a692-kube-api-access-nbszv\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597569    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597604    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-cni-multus\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597627    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddq9k\" (UniqueName: \"kubernetes.io/projected/c043f0f2-4d45-4e44-859d-9666290b402a-kube-api-access-ddq9k\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597646    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/309ddb97-fafb-42f2-b000-197b4c371c6c-agent-certs\") pod \"konnectivity-agent-kdmx6\" (UID: \"309ddb97-fafb-42f2-b000-197b4c371c6c\") " pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597664    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-cnibin\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597680    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-os-release\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597744    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-cni-multus\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597746    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7b0c1a6-6262-4585-8a01-541a8a412bcc-iptables-alerter-script\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.597786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597799    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-k8s-cni-cncf-io\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597828    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqmxc\" (UniqueName: \"kubernetes.io/projected/b7b0c1a6-6262-4585-8a01-541a8a412bcc-kube-api-access-qqmxc\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597854    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/499a1f52-1802-42a4-b958-40b25212a692-hosts-file\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597872    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-os-release\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597884    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fczgp\" (UniqueName: \"kubernetes.io/projected/f42b5fdf-69ac-4ce7-bf53-425516d05f89-kube-api-access-fczgp\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597833    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-k8s-cni-cncf-io\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597799    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-cnibin\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597919    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c043f0f2-4d45-4e44-859d-9666290b402a-multus-daemon-config\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597943    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/499a1f52-1802-42a4-b958-40b25212a692-hosts-file\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597949    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smg2q\" (UniqueName: \"kubernetes.io/projected/1edae93b-ecb6-40fc-91a1-5ef01b981e95-kube-api-access-smg2q\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.597995    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cnibin\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598021    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-socket-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598064    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598087    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/499a1f52-1802-42a4-b958-40b25212a692-tmp-dir\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598157    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-os-release\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598170    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598181    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-conf-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.598430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598216    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-registration-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598227    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-socket-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598261    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-conf-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598272    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cnibin\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598273    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-registration-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598303    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598329    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-os-release\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598333    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7b0c1a6-6262-4585-8a01-541a8a412bcc-iptables-alerter-script\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598363    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-multus-certs\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598334    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-multus-certs\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598404    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-device-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598429    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-hostroot\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598440    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598456    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqwg2\" (UniqueName: \"kubernetes.io/projected/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-kube-api-access-zqwg2\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598479    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/499a1f52-1802-42a4-b958-40b25212a692-tmp-dir\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598481    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-hostroot\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598504    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c043f0f2-4d45-4e44-859d-9666290b402a-multus-daemon-config\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598523    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-device-dir\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598482    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7b0c1a6-6262-4585-8a01-541a8a412bcc-host-slash\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598545    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7b0c1a6-6262-4585-8a01-541a8a412bcc-host-slash\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598572    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598623    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-system-cni-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598664    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-etc-kubernetes\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598692    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-system-cni-dir\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598717    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598719    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-etc-kubernetes\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598721    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-system-cni-dir\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598743    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c043f0f2-4d45-4e44-859d-9666290b402a-cni-binary-copy\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598758    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f42b5fdf-69ac-4ce7-bf53-425516d05f89-system-cni-dir\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.598766    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-socket-dir-parent\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599039    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1edae93b-ecb6-40fc-91a1-5ef01b981e95-serviceca\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599188    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cni-binary-copy\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599208    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-multus-socket-dir-parent\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599268    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/309ddb97-fafb-42f2-b000-197b4c371c6c-konnectivity-ca\") pod \"konnectivity-agent-kdmx6\" (UID: \"309ddb97-fafb-42f2-b000-197b4c371c6c\") " pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:10:46.599854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599287    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-netns\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.600430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599301    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-kubelet\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.600430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599351    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f42b5fdf-69ac-4ce7-bf53-425516d05f89-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.600430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599359    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-var-lib-kubelet\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.600430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599381    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c043f0f2-4d45-4e44-859d-9666290b402a-host-run-netns\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.600430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599559    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c043f0f2-4d45-4e44-859d-9666290b402a-cni-binary-copy\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.600430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.599886    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/309ddb97-fafb-42f2-b000-197b4c371c6c-konnectivity-ca\") pod \"konnectivity-agent-kdmx6\" (UID: \"309ddb97-fafb-42f2-b000-197b4c371c6c\") " pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:10:46.600807 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.600792    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/309ddb97-fafb-42f2-b000-197b4c371c6c-agent-certs\") pod \"konnectivity-agent-kdmx6\" (UID: \"309ddb97-fafb-42f2-b000-197b4c371c6c\") " pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:10:46.615048 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.615018    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddq9k\" (UniqueName: \"kubernetes.io/projected/c043f0f2-4d45-4e44-859d-9666290b402a-kube-api-access-ddq9k\") pod \"multus-jq6vz\" (UID: \"c043f0f2-4d45-4e44-859d-9666290b402a\") " pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.620077 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.620058    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqmxc\" (UniqueName: \"kubernetes.io/projected/b7b0c1a6-6262-4585-8a01-541a8a412bcc-kube-api-access-qqmxc\") pod \"iptables-alerter-sbt9k\" (UID: \"b7b0c1a6-6262-4585-8a01-541a8a412bcc\") " pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.621354 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.621328    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbszv\" (UniqueName: \"kubernetes.io/projected/499a1f52-1802-42a4-b958-40b25212a692-kube-api-access-nbszv\") pod \"node-resolver-kmsf9\" (UID: \"499a1f52-1802-42a4-b958-40b25212a692\") " pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.622321 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.622305    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqwg2\" (UniqueName: \"kubernetes.io/projected/356eab9b-2da5-48cf-bc70-61aa50f9bb5c-kube-api-access-zqwg2\") pod \"aws-ebs-csi-driver-node-vkqt5\" (UID: \"356eab9b-2da5-48cf-bc70-61aa50f9bb5c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.626261 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.626244    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:46.626338 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.626265    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:46.626338 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.626275    2550 projected.go:196] Error preparing data for projected volume kube-api-access-dfn98 for pod openshift-network-diagnostics/network-check-target-nl2sk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:46.626338 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:46.626330    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98 podName:3a31ca9f-839f-421f-9572-b8d6477e1496 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:47.126316031 +0000 UTC m=+2.117276268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dfn98" (UniqueName: "kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98") pod "network-check-target-nl2sk" (UID: "3a31ca9f-839f-421f-9572-b8d6477e1496") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:46.627339 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.627321    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fczgp\" (UniqueName: \"kubernetes.io/projected/f42b5fdf-69ac-4ce7-bf53-425516d05f89-kube-api-access-fczgp\") pod \"multus-additional-cni-plugins-d7d8c\" (UID: \"f42b5fdf-69ac-4ce7-bf53-425516d05f89\") " pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.627573 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.627558    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smg2q\" (UniqueName: \"kubernetes.io/projected/1edae93b-ecb6-40fc-91a1-5ef01b981e95-kube-api-access-smg2q\") pod \"node-ca-9gjcr\" (UID: \"1edae93b-ecb6-40fc-91a1-5ef01b981e95\") " pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.708055 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.707961    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:10:46.717034 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.717010    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe7a1bc_f1f1_44cd_a7b0_da7cf617713c.slice/crio-d536ed5cfc251f56c619ddff37d2cda8a74dd8727385361c685faa5d83a3fea7 WatchSource:0}: Error finding container d536ed5cfc251f56c619ddff37d2cda8a74dd8727385361c685faa5d83a3fea7: Status 404 returned error can't find the container with id d536ed5cfc251f56c619ddff37d2cda8a74dd8727385361c685faa5d83a3fea7
Jul 02 17:10:46.729364 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.729332    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vsqvj"
Jul 02 17:10:46.736731 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.736706    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c3eb08_f6ac_4c85_abf4_998b19bd0e5b.slice/crio-4d5b3ab1cd3061feb3dd24103a14b1db9bcfad5d3febbdedfbf08c58a6d7926f WatchSource:0}: Error finding container 4d5b3ab1cd3061feb3dd24103a14b1db9bcfad5d3febbdedfbf08c58a6d7926f: Status 404 returned error can't find the container with id 4d5b3ab1cd3061feb3dd24103a14b1db9bcfad5d3febbdedfbf08c58a6d7926f
Jul 02 17:10:46.751471 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.751451    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9gjcr"
Jul 02 17:10:46.758886 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.758861    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1edae93b_ecb6_40fc_91a1_5ef01b981e95.slice/crio-ef2b4401746f3deb270fb9c7422919ba8fc77a0634f366eddf11149799849267 WatchSource:0}: Error finding container ef2b4401746f3deb270fb9c7422919ba8fc77a0634f366eddf11149799849267: Status 404 returned error can't find the container with id ef2b4401746f3deb270fb9c7422919ba8fc77a0634f366eddf11149799849267
Jul 02 17:10:46.765484 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.765462    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d7d8c"
Jul 02 17:10:46.772873 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.772851    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42b5fdf_69ac_4ce7_bf53_425516d05f89.slice/crio-ab3ff492b14687f1a56ecbe4e8f3861ffb7d6e314e6a8ae99d3ddbecd37bf789 WatchSource:0}: Error finding container ab3ff492b14687f1a56ecbe4e8f3861ffb7d6e314e6a8ae99d3ddbecd37bf789: Status 404 returned error can't find the container with id ab3ff492b14687f1a56ecbe4e8f3861ffb7d6e314e6a8ae99d3ddbecd37bf789
Jul 02 17:10:46.780469 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.780450    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jq6vz"
Jul 02 17:10:46.787108 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.787080    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc043f0f2_4d45_4e44_859d_9666290b402a.slice/crio-34230ae363d07d09929abd97894e6518b1867cad2b7fbe7f15d407e2d1f31e13 WatchSource:0}: Error finding container 34230ae363d07d09929abd97894e6518b1867cad2b7fbe7f15d407e2d1f31e13: Status 404 returned error can't find the container with id 34230ae363d07d09929abd97894e6518b1867cad2b7fbe7f15d407e2d1f31e13
Jul 02 17:10:46.793523 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.793506    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sbt9k"
Jul 02 17:10:46.800552 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.800530    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b0c1a6_6262_4585_8a01_541a8a412bcc.slice/crio-89b6408e4297bbdb3c12cfdb0f3e399b6e97db235ad4d32cd3ef760216b7fc48 WatchSource:0}: Error finding container 89b6408e4297bbdb3c12cfdb0f3e399b6e97db235ad4d32cd3ef760216b7fc48: Status 404 returned error can't find the container with id 89b6408e4297bbdb3c12cfdb0f3e399b6e97db235ad4d32cd3ef760216b7fc48
Jul 02 17:10:46.820496 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.820471    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:10:46.828457 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.828431    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod309ddb97_fafb_42f2_b000_197b4c371c6c.slice/crio-9b199300de4206af5624b34774311add76ef15c428baf0b0a34a6097b9b3c2e8 WatchSource:0}: Error finding container 9b199300de4206af5624b34774311add76ef15c428baf0b0a34a6097b9b3c2e8: Status 404 returned error can't find the container with id 9b199300de4206af5624b34774311add76ef15c428baf0b0a34a6097b9b3c2e8
Jul 02 17:10:46.837547 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.837521    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5"
Jul 02 17:10:46.842564 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.842541    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kmsf9"
Jul 02 17:10:46.844987 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.844965    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356eab9b_2da5_48cf_bc70_61aa50f9bb5c.slice/crio-e21ed6fa9d0fbd6db981395b56688f3fad99ca04441c23e750cd1608e008e08b WatchSource:0}: Error finding container e21ed6fa9d0fbd6db981395b56688f3fad99ca04441c23e750cd1608e008e08b: Status 404 returned error can't find the container with id e21ed6fa9d0fbd6db981395b56688f3fad99ca04441c23e750cd1608e008e08b
Jul 02 17:10:46.850311 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:10:46.850288    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499a1f52_1802_42a4_b958_40b25212a692.slice/crio-daada8cc7215a1738c8f969fa0353ea60f2be093091630fc5a97a55034e30302 WatchSource:0}: Error finding container daada8cc7215a1738c8f969fa0353ea60f2be093091630fc5a97a55034e30302: Status 404 returned error can't find the container with id daada8cc7215a1738c8f969fa0353ea60f2be093091630fc5a97a55034e30302
Jul 02 17:10:46.923413 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:46.921172    2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:47.002002 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.001916    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:47.002002 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.001972    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:47.002194 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:47.002078    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:47.002194 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:47.002080    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:47.002194 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:47.002144    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:10:48.002128864 +0000 UTC m=+2.993089097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:47.002194 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:47.002160    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret podName:1f43ef34-2095-452e-9da1-b557b4ac5d11 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:48.002152845 +0000 UTC m=+2.993113078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret") pod "global-pull-secret-syncer-j9gxg" (UID: "1f43ef34-2095-452e-9da1-b557b4ac5d11") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:47.203308 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.203267    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:47.203499 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:47.203454    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:47.203499 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:47.203477    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:47.203499 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:47.203491    2550 projected.go:196] Error preparing data for projected volume kube-api-access-dfn98 for pod openshift-network-diagnostics/network-check-target-nl2sk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:47.203677 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:47.203554    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98 podName:3a31ca9f-839f-421f-9572-b8d6477e1496 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:48.203535594 +0000 UTC m=+3.194495833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfn98" (UniqueName: "kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98") pod "network-check-target-nl2sk" (UID: "3a31ca9f-839f-421f-9572-b8d6477e1496") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:47.409729 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.409641    2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 17:10:47.487793 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.487681    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vsqvj" event={"ID":"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b","Type":"ContainerStarted","Data":"4d5b3ab1cd3061feb3dd24103a14b1db9bcfad5d3febbdedfbf08c58a6d7926f"}
Jul 02 17:10:47.506925 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.506885    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal" event={"ID":"b41ad76e29acdf1dd373255071bc14d7","Type":"ContainerStarted","Data":"4912f928486a8ef0dd2b8279ccbcccf2e6cc90c6f4c73dd55b8bbe2a89e58857"}
Jul 02 17:10:47.512105 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.512023    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" event={"ID":"f42b5fdf-69ac-4ce7-bf53-425516d05f89","Type":"ContainerStarted","Data":"ab3ff492b14687f1a56ecbe4e8f3861ffb7d6e314e6a8ae99d3ddbecd37bf789"}
Jul 02 17:10:47.520265 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.520223    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9gjcr" event={"ID":"1edae93b-ecb6-40fc-91a1-5ef01b981e95","Type":"ContainerStarted","Data":"ef2b4401746f3deb270fb9c7422919ba8fc77a0634f366eddf11149799849267"}
Jul 02 17:10:47.533380 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.533336    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"d536ed5cfc251f56c619ddff37d2cda8a74dd8727385361c685faa5d83a3fea7"}
Jul 02 17:10:47.542348 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.542285    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 17:05:46 +0000 UTC" deadline="2028-03-28 21:52:23.839050816 +0000 UTC"
Jul 02 17:10:47.542348 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.542346    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15244h41m36.296708982s"
Jul 02 17:10:47.550838 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.550803    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal" event={"ID":"8af002de85c52f61eae8d9d440ef017d","Type":"ContainerStarted","Data":"e1799452c928c5bf33d4c0bf0e1d430be0d091a5ccb97d1354f7110c5df3c429"}
Jul 02 17:10:47.560757 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.560721    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kmsf9" event={"ID":"499a1f52-1802-42a4-b958-40b25212a692","Type":"ContainerStarted","Data":"daada8cc7215a1738c8f969fa0353ea60f2be093091630fc5a97a55034e30302"}
Jul 02 17:10:47.574474 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.574441    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5" event={"ID":"356eab9b-2da5-48cf-bc70-61aa50f9bb5c","Type":"ContainerStarted","Data":"e21ed6fa9d0fbd6db981395b56688f3fad99ca04441c23e750cd1608e008e08b"}
Jul 02 17:10:47.577272 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.577242    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdmx6" event={"ID":"309ddb97-fafb-42f2-b000-197b4c371c6c","Type":"ContainerStarted","Data":"9b199300de4206af5624b34774311add76ef15c428baf0b0a34a6097b9b3c2e8"}
Jul 02 17:10:47.582637 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.582524    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sbt9k" event={"ID":"b7b0c1a6-6262-4585-8a01-541a8a412bcc","Type":"ContainerStarted","Data":"89b6408e4297bbdb3c12cfdb0f3e399b6e97db235ad4d32cd3ef760216b7fc48"}
Jul 02 17:10:47.587205 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:47.587177    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jq6vz" event={"ID":"c043f0f2-4d45-4e44-859d-9666290b402a","Type":"ContainerStarted","Data":"34230ae363d07d09929abd97894e6518b1867cad2b7fbe7f15d407e2d1f31e13"}
Jul 02 17:10:48.011704 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:48.010947    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:48.011704 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:48.011016    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:48.011704 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.011135    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:48.011704 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.011198    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret podName:1f43ef34-2095-452e-9da1-b557b4ac5d11 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:50.011178492 +0000 UTC m=+5.002138747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret") pod "global-pull-secret-syncer-j9gxg" (UID: "1f43ef34-2095-452e-9da1-b557b4ac5d11") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:48.011704 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.011613    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:48.011704 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.011666    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:10:50.011650076 +0000 UTC m=+5.002610316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:48.213032 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:48.212997    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:48.213200 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.213188    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:48.213274 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.213210    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:48.213274 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.213222    2550 projected.go:196] Error preparing data for projected volume kube-api-access-dfn98 for pod openshift-network-diagnostics/network-check-target-nl2sk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:48.213369 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.213280    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98 podName:3a31ca9f-839f-421f-9572-b8d6477e1496 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:50.213263396 +0000 UTC m=+5.204223631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfn98" (UniqueName: "kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98") pod "network-check-target-nl2sk" (UID: "3a31ca9f-839f-421f-9572-b8d6477e1496") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:48.449025 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:48.448936    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:48.449474 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.449077    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:10:48.449541 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:48.449476    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:48.449629 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.449583    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:10:48.449701 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:48.449668    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:48.449750 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:48.449735    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:10:48.542821 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:48.542781    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 17:05:46 +0000 UTC" deadline="2027-12-10 08:21:12.413800082 +0000 UTC"
Jul 02 17:10:48.542821 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:48.542819    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12615h10m23.870985287s"
Jul 02 17:10:50.028971 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:50.028935    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:50.029465 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:50.029018    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:50.029465 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.029162    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:50.029465 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.029226    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:10:54.029207022 +0000 UTC m=+9.020167278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:50.029678 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.029632    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:50.029735 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.029682    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret podName:1f43ef34-2095-452e-9da1-b557b4ac5d11 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:54.029666761 +0000 UTC m=+9.020627013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret") pod "global-pull-secret-syncer-j9gxg" (UID: "1f43ef34-2095-452e-9da1-b557b4ac5d11") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:50.232324 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:50.231703    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:50.232324 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.231890    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:50.232324 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.231913    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:50.232324 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.231926    2550 projected.go:196] Error preparing data for projected volume kube-api-access-dfn98 for pod openshift-network-diagnostics/network-check-target-nl2sk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:50.232324 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.231984    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98 podName:3a31ca9f-839f-421f-9572-b8d6477e1496 nodeName:}" failed. No retries permitted until 2026-07-02 17:10:54.23196632 +0000 UTC m=+9.222926552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfn98" (UniqueName: "kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98") pod "network-check-target-nl2sk" (UID: "3a31ca9f-839f-421f-9572-b8d6477e1496") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:50.448830 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:50.448688    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:50.448830 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:50.448703    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:50.449055 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.448834    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:10:50.449055 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:50.448845    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:50.449055 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.448952    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:10:50.449055 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:50.449036    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:10:52.448290 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:52.448249    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:52.448290 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:52.448286    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:52.448852 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:52.448249    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:52.448852 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:52.448375    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:10:52.448852 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:52.448461    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:10:52.448852 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:52.448529    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:10:54.067477 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:54.067206    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:54.067958 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.067414    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:54.067958 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.067633    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:11:02.067605432 +0000 UTC m=+17.058565690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:10:54.067958 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.067639    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:54.067958 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.067698    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret podName:1f43ef34-2095-452e-9da1-b557b4ac5d11 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:02.0676805 +0000 UTC m=+17.058640733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret") pod "global-pull-secret-syncer-j9gxg" (UID: "1f43ef34-2095-452e-9da1-b557b4ac5d11") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:10:54.067958 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:54.067527    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:54.269800 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:54.269762    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:54.270046 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.270013    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:10:54.270046 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.270043    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:10:54.270237 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.270057    2550 projected.go:196] Error preparing data for projected volume kube-api-access-dfn98 for pod openshift-network-diagnostics/network-check-target-nl2sk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:54.270237 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.270131    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98 podName:3a31ca9f-839f-421f-9572-b8d6477e1496 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:02.270113819 +0000 UTC m=+17.261074072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfn98" (UniqueName: "kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98") pod "network-check-target-nl2sk" (UID: "3a31ca9f-839f-421f-9572-b8d6477e1496") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:10:54.448526 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:54.448449    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:54.448849 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.448609    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:10:54.448849 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:54.448701    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:54.448849 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.448796    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:10:54.448849 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:54.448844    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:54.449038 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:54.448918    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:10:56.448953 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:56.448911    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:56.449394 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:56.448966    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:56.449394 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:56.449072    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:10:56.449394 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:56.449125    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:10:56.449394 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:56.449191    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:56.449394 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:56.449275    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:10:58.448698 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:58.448664    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:10:58.449057 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:58.448664    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:10:58.449057 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:58.448774    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:10:58.449057 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:58.448859    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:10:58.449057 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:10:58.448664    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:10:58.449057 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:10:58.448936    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:00.448289 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:00.448252    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:00.448752 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:00.448257    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:00.448752 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:00.448352    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:00.448752 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:00.448380    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:00.448752 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:00.448471    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:00.448752 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:00.448552    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:02.128979 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:02.128944    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:02.129450 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:02.129009    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:02.129450 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.129102    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:11:02.129450 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.129171    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:11:18.129156147 +0000 UTC m=+33.120116384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:11:02.129450 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.129106    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:11:02.129450 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.129231    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret podName:1f43ef34-2095-452e-9da1-b557b4ac5d11 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:18.129217723 +0000 UTC m=+33.120177956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret") pod "global-pull-secret-syncer-j9gxg" (UID: "1f43ef34-2095-452e-9da1-b557b4ac5d11") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:11:02.330073 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:02.330033    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:02.330249 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.330222    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:11:02.330249 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.330245    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:11:02.330329 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.330256    2550 projected.go:196] Error preparing data for projected volume kube-api-access-dfn98 for pod openshift-network-diagnostics/network-check-target-nl2sk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:11:02.330329 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.330308    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98 podName:3a31ca9f-839f-421f-9572-b8d6477e1496 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:18.330294369 +0000 UTC m=+33.321254602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfn98" (UniqueName: "kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98") pod "network-check-target-nl2sk" (UID: "3a31ca9f-839f-421f-9572-b8d6477e1496") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:11:02.448615 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:02.448515    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:02.448615 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:02.448534    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:02.448846 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.448659    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:02.448846 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.448742    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:02.448846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:02.448765    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:02.448986 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:02.448853    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:04.449051 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:04.449012    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:04.449641 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:04.449012    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:04.449641 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:04.449146    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:04.449641 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:04.449012    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:04.449641 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:04.449221    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:04.449641 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:04.449328    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:06.448668 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:06.448630    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:06.449048 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:06.448633    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:06.449048 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:06.448736    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:06.449048 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:06.448633    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:06.449048 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:06.448826    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:06.449048 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:06.448903    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:07.628065 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.627859    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jq6vz" event={"ID":"c043f0f2-4d45-4e44-859d-9666290b402a","Type":"ContainerStarted","Data":"0bd332880835bb4fbc31e09845169c1b02b07488e3eb12c3b9c32749bca48707"}
Jul 02 17:11:07.629426 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.629399    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vsqvj" event={"ID":"84c3eb08-f6ac-4c85-abf4-998b19bd0e5b","Type":"ContainerStarted","Data":"62899d05a7588de8fd6cfe37f7bcadb3a78817ed9b3c01e19a95985241f2db2d"}
Jul 02 17:11:07.632512 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.632494    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:11:07.632866 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.632847    2550 generic.go:356] "Generic (PLEG): container finished" podID="fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c" containerID="5e44c6f6f69e777d79eda28201ad639647e7aab39f1bb3a6fe1604870541ca3b" exitCode=1
Jul 02 17:11:07.632936 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.632915    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"083d4b98e90ee55da64d15aef775ef944d648d7f90f9fa99f68776ceac524958"}
Jul 02 17:11:07.633004 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.632990    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"66b6f61b56634ff4781e312c2f90c65934d6cf5feba1bccb0cf0e215a8a8882a"}
Jul 02 17:11:07.633047 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.633029    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerDied","Data":"5e44c6f6f69e777d79eda28201ad639647e7aab39f1bb3a6fe1604870541ca3b"}
Jul 02 17:11:07.633088 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.633061    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"47e37b2f6e3a67c3cd527259bcb95933066f89d4d6a648343d42dbfcb0781da4"}
Jul 02 17:11:07.634457 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.634438    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal" event={"ID":"8af002de85c52f61eae8d9d440ef017d","Type":"ContainerStarted","Data":"0753d5cae7c062d68aa163bb99a3b1fbf26eb8359f62706f4feb371cf35e4df3"}
Jul 02 17:11:07.645565 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.645523    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jq6vz" podStartSLOduration=2.18669893 podStartE2EDuration="22.645508574s" totalImagesPullingTime="20.458809644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:07.645153493 +0000 UTC m=+22.636113747" watchObservedRunningTime="2026-07-02 17:11:07.645508574 +0000 UTC m=+22.636468828"
Jul 02 17:11:07.659089 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:07.659033    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-98.ec2.internal" podStartSLOduration=21.659013895 podStartE2EDuration="21.659013895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:07.658731416 +0000 UTC m=+22.649691696" watchObservedRunningTime="2026-07-02 17:11:07.659013895 +0000 UTC m=+22.649974153"
Jul 02 17:11:08.448315 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.448125    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:08.448489 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.448125    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:08.448489 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:08.448386    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:08.448623 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:08.448501    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:08.448623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.448126    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:08.448623 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:08.448584    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:08.639933 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.639907    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:11:08.640493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.640343    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"b9c715892df09a03c169725217f8abe5e320614817fc5100a69a4ccda660b8c6"}
Jul 02 17:11:08.640493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.640429    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"2809cb2eb579bdd5d9c5c03395e7165bba302ab9de6585814a2dea6bab1c38bd"}
Jul 02 17:11:08.641890 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.641865    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kmsf9" event={"ID":"499a1f52-1802-42a4-b958-40b25212a692","Type":"ContainerStarted","Data":"a5a143b7996fb8c5257131928780bddf261425f4a9c63855db222f9400e35811"}
Jul 02 17:11:08.643473 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.643454    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5" event={"ID":"356eab9b-2da5-48cf-bc70-61aa50f9bb5c","Type":"ContainerStarted","Data":"72e330aec1912fcc1e907ab0e2d067c5462768d6c3df8b83b926a02ae78bcbf9"}
Jul 02 17:11:08.644932 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.644897    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdmx6" event={"ID":"309ddb97-fafb-42f2-b000-197b4c371c6c","Type":"ContainerStarted","Data":"8f34109237db36863501466c9e7bcdede65a98f683e86873048fc8a95d3e9d8e"}
Jul 02 17:11:08.646426 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.646399    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sbt9k" event={"ID":"b7b0c1a6-6262-4585-8a01-541a8a412bcc","Type":"ContainerStarted","Data":"642f37ebdea6cf7b970cacf62ea143696a83abe50aa0c0d2290be9c197580ded"}
Jul 02 17:11:08.648063 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.648041    2550 generic.go:356] "Generic (PLEG): container finished" podID="b41ad76e29acdf1dd373255071bc14d7" containerID="759a3952b9a7e781e9e54f6833291066a48602542527c1faf6ad994a938208b0" exitCode=0
Jul 02 17:11:08.648162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.648121    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal" event={"ID":"b41ad76e29acdf1dd373255071bc14d7","Type":"ContainerDied","Data":"759a3952b9a7e781e9e54f6833291066a48602542527c1faf6ad994a938208b0"}
Jul 02 17:11:08.649886 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.649862    2550 generic.go:356] "Generic (PLEG): container finished" podID="f42b5fdf-69ac-4ce7-bf53-425516d05f89" containerID="bf9251e9b46ba72859b98a182a434d1a83a7e528c47802e3cb2e92e07d86448b" exitCode=0
Jul 02 17:11:08.649990 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.649953    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" event={"ID":"f42b5fdf-69ac-4ce7-bf53-425516d05f89","Type":"ContainerDied","Data":"bf9251e9b46ba72859b98a182a434d1a83a7e528c47802e3cb2e92e07d86448b"}
Jul 02 17:11:08.651681 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.651615    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9gjcr" event={"ID":"1edae93b-ecb6-40fc-91a1-5ef01b981e95","Type":"ContainerStarted","Data":"bab8f003550bd92c02f315bfc9b3bb5e8d2f7b16ce79a1baf00013cce258526e"}
Jul 02 17:11:08.656387 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.656340    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vsqvj" podStartSLOduration=3.422320286 podStartE2EDuration="23.656324469s" totalImagesPullingTime="20.234004183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:07.677878498 +0000 UTC m=+22.668838753" watchObservedRunningTime="2026-07-02 17:11:08.656324469 +0000 UTC m=+23.647284725"
Jul 02 17:11:08.656960 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.656930    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kmsf9" podStartSLOduration=3.538620368 podStartE2EDuration="23.656920457s" totalImagesPullingTime="20.118300089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:08.656268976 +0000 UTC m=+23.647229266" watchObservedRunningTime="2026-07-02 17:11:08.656920457 +0000 UTC m=+23.647880711"
Jul 02 17:11:08.669292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.669153    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sbt9k" podStartSLOduration=3.5006040670000003 podStartE2EDuration="23.669135818s" totalImagesPullingTime="20.168531751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:08.668885935 +0000 UTC m=+23.659846191" watchObservedRunningTime="2026-07-02 17:11:08.669135818 +0000 UTC m=+23.660096075"
Jul 02 17:11:08.698782 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.698736    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9gjcr" podStartSLOduration=3.488659256 podStartE2EDuration="23.698721847s" totalImagesPullingTime="20.210062591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:08.698181128 +0000 UTC m=+23.689141383" watchObservedRunningTime="2026-07-02 17:11:08.698721847 +0000 UTC m=+23.689682102"
Jul 02 17:11:08.739359 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:08.739306    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kdmx6" podStartSLOduration=11.85235427 podStartE2EDuration="23.73929088s" totalImagesPullingTime="11.88693661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:08.738515917 +0000 UTC m=+23.729476191" watchObservedRunningTime="2026-07-02 17:11:08.73929088 +0000 UTC m=+23.730251134"
Jul 02 17:11:09.153207 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.153180    2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 17:11:09.469892 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.469729    2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T17:11:09.15320231Z","UUID":"dd258464-4496-47e5-b2ed-98811e56688c","Handler":null,"Name":"","Endpoint":""}
Jul 02 17:11:09.471716 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.471686    2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 17:11:09.471866 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.471725    2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 17:11:09.653458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.653423    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:11:09.654149 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.654123    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:11:09.656321 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.656291    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal" event={"ID":"b41ad76e29acdf1dd373255071bc14d7","Type":"ContainerStarted","Data":"7ec94440f952af198851134ea000c1310dc32ad1d5d269d6b6b0482cced0dde7"}
Jul 02 17:11:09.658298 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.658264    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5" event={"ID":"356eab9b-2da5-48cf-bc70-61aa50f9bb5c","Type":"ContainerStarted","Data":"bf3f0ff0c1548fd5f66014fd94264b3cc844bb4376406e3e308f12fbe6279906"}
Jul 02 17:11:09.658824 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.658803    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:11:09.659125 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.659108    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kdmx6"
Jul 02 17:11:09.692667 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:09.692587    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-98.ec2.internal" podStartSLOduration=23.692565384 podStartE2EDuration="23.692565384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:09.692174667 +0000 UTC m=+24.683134922" watchObservedRunningTime="2026-07-02 17:11:09.692565384 +0000 UTC m=+24.683525640"
Jul 02 17:11:10.448490 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:10.448450    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:10.448742 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:10.448462    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:10.448742 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:10.448616    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:10.448742 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:10.448464    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:10.448742 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:10.448660    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:10.448742 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:10.448738    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:10.663410 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:10.663370    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5" event={"ID":"356eab9b-2da5-48cf-bc70-61aa50f9bb5c","Type":"ContainerStarted","Data":"a26150253247e979eca605737efef6a71b6602f15bf14eb6dc8d7323b9323c89"}
Jul 02 17:11:10.666861 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:10.666829    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:11:10.667223 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:10.667202    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"cad77eef0b66d4740fdef515f02efef0f3f305499f97be01d9a209baf5612f6a"}
Jul 02 17:11:10.682055 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:10.682011    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vkqt5" podStartSLOduration=2.947526339 podStartE2EDuration="25.681996514s" totalImagesPullingTime="22.734470175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:10.68150596 +0000 UTC m=+25.672466215" watchObservedRunningTime="2026-07-02 17:11:10.681996514 +0000 UTC m=+25.672956769"
Jul 02 17:11:12.449148 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:12.449049    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:12.449642 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:12.449174    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:12.449642 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:12.449190    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:12.449642 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:12.449184    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:12.449642 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:12.449287    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:12.452174 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:12.450393    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:13.676233 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:13.676045    2550 generic.go:356] "Generic (PLEG): container finished" podID="f42b5fdf-69ac-4ce7-bf53-425516d05f89" containerID="d32d9ac85253f6f45fc973d720c8b015726d2ecf6d083274ba8f0ff04d3c2e3a" exitCode=0
Jul 02 17:11:13.677068 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:13.676103    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" event={"ID":"f42b5fdf-69ac-4ce7-bf53-425516d05f89","Type":"ContainerDied","Data":"d32d9ac85253f6f45fc973d720c8b015726d2ecf6d083274ba8f0ff04d3c2e3a"}
Jul 02 17:11:13.679872 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:13.679851    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:11:13.680233 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:13.680213    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"1a7789952d35fa51afde429a31d5af220f22b0d4c5049ee368d95ba2ac530891"}
Jul 02 17:11:13.680411 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:13.680394    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:11:13.680536 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:13.680435    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:11:13.680649 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:13.680634    2550 scope.go:117] "RemoveContainer" containerID="5e44c6f6f69e777d79eda28201ad639647e7aab39f1bb3a6fe1604870541ca3b"
Jul 02 17:11:13.697739 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:13.697715    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:11:14.449315 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.449102    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:14.449622 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.449115    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:14.449622 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:14.449387    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:14.449622 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.449167    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:14.449622 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:14.449476    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:14.449622 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:14.449521    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:14.689077 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.689048    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:11:14.689494 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.689475    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" event={"ID":"fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c","Type":"ContainerStarted","Data":"c5f69b64d32edc6241d04aec4d2a44670dc596f4b9f2b394a277adff89f2247b"}
Jul 02 17:11:14.689822 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.689798    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:11:14.707094 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.707026    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:11:14.721564 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.721522    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx" podStartSLOduration=9.427379954 podStartE2EDuration="29.721507912s" totalImagesPullingTime="20.294127958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:14.720389346 +0000 UTC m=+29.711349602" watchObservedRunningTime="2026-07-02 17:11:14.721507912 +0000 UTC m=+29.712468166"
Jul 02 17:11:14.807989 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.807961    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j9gxg"]
Jul 02 17:11:14.808124 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.808112    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:14.808223 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:14.808201    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:14.812194 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.812167    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8npvm"]
Jul 02 17:11:14.812332 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.812317    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:14.812470 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:14.812444    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:14.812828 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.812807    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nl2sk"]
Jul 02 17:11:14.812911 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:14.812902    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:14.813001 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:14.812981    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:15.694410 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:15.694377    2550 generic.go:356] "Generic (PLEG): container finished" podID="f42b5fdf-69ac-4ce7-bf53-425516d05f89" containerID="957bf701ff17b8388316b2e81ffc2572f46670b124d405caf3a08d5840408337" exitCode=0
Jul 02 17:11:15.694878 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:15.694473    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" event={"ID":"f42b5fdf-69ac-4ce7-bf53-425516d05f89","Type":"ContainerDied","Data":"957bf701ff17b8388316b2e81ffc2572f46670b124d405caf3a08d5840408337"}
Jul 02 17:11:16.448953 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:16.448914    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:16.449092 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:16.448925    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:16.449092 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:16.449042    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:16.449161 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:16.449141    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:16.449199 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:16.448930    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:16.449243 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:16.449221    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:16.699710 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:16.699629    2550 generic.go:356] "Generic (PLEG): container finished" podID="f42b5fdf-69ac-4ce7-bf53-425516d05f89" containerID="2f15c36700e8836d3fb6713191a84352c12f3df73bae68abcf9f14f64582936c" exitCode=0
Jul 02 17:11:16.699710 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:16.699696    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" event={"ID":"f42b5fdf-69ac-4ce7-bf53-425516d05f89","Type":"ContainerDied","Data":"2f15c36700e8836d3fb6713191a84352c12f3df73bae68abcf9f14f64582936c"}
Jul 02 17:11:18.151576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:18.151489    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:18.151576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:18.151547    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:18.152080 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.151666    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:11:18.152080 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.151687    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 17:11:18.152080 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.151737    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:11:50.151717933 +0000 UTC m=+65.142678180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 17:11:18.152080 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.151758    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret podName:1f43ef34-2095-452e-9da1-b557b4ac5d11 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:50.151748154 +0000 UTC m=+65.142708388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret") pod "global-pull-secret-syncer-j9gxg" (UID: "1f43ef34-2095-452e-9da1-b557b4ac5d11") : object "kube-system"/"original-pull-secret" not registered
Jul 02 17:11:18.353002 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:18.352972    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:18.353163 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.353092    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 17:11:18.353163 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.353106    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 17:11:18.353163 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.353115    2550 projected.go:196] Error preparing data for projected volume kube-api-access-dfn98 for pod openshift-network-diagnostics/network-check-target-nl2sk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:11:18.353163 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.353161    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98 podName:3a31ca9f-839f-421f-9572-b8d6477e1496 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:50.353148056 +0000 UTC m=+65.344108288 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfn98" (UniqueName: "kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98") pod "network-check-target-nl2sk" (UID: "3a31ca9f-839f-421f-9572-b8d6477e1496") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 17:11:18.448355 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:18.448277    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:18.448355 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:18.448304    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:18.448355 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:18.448309    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:18.448549 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.448395    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nl2sk" podUID="3a31ca9f-839f-421f-9572-b8d6477e1496"
Jul 02 17:11:18.448549 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.448455    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:11:18.448549 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:18.448526    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j9gxg" podUID="1f43ef34-2095-452e-9da1-b557b4ac5d11"
Jul 02 17:11:19.768731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.768538    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-98.ec2.internal" event="NodeReady"
Jul 02 17:11:19.769143 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.768882    2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 17:11:19.822419 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.822382    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zprb9"]
Jul 02 17:11:19.824650 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.824634    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:19.826414 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.826389    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-44hnn"]
Jul 02 17:11:19.827119 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.827048    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wfcqg\""
Jul 02 17:11:19.827119 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.827047    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 17:11:19.827297 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.827140    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 17:11:19.828625 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.828539    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-44hnn"
Jul 02 17:11:19.830900 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.830881    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 17:11:19.831176 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.831153    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nbjgv\""
Jul 02 17:11:19.831815 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.831773    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 17:11:19.831952 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.831895    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 17:11:19.841520 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.841499    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-44hnn"]
Jul 02 17:11:19.843274 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.843255    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zprb9"]
Jul 02 17:11:19.964539 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.964470    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e33937-2ee1-417e-b72a-d42210ef3239-tmp-dir\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:19.964539 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.964509    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e33937-2ee1-417e-b72a-d42210ef3239-config-volume\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:19.964539 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.964538    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99g58\" (UniqueName: \"kubernetes.io/projected/f8e33937-2ee1-417e-b72a-d42210ef3239-kube-api-access-99g58\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:19.964779 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.964669    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:19.964779 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.964696    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9bb\" (UniqueName: \"kubernetes.io/projected/90a8562e-b969-4425-9ef3-5d30ac22fe70-kube-api-access-mx9bb\") pod \"ingress-canary-44hnn\" (UID: \"90a8562e-b969-4425-9ef3-5d30ac22fe70\") " pod="openshift-ingress-canary/ingress-canary-44hnn"
Jul 02 17:11:19.964779 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:19.964744    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90a8562e-b969-4425-9ef3-5d30ac22fe70-cert\") pod \"ingress-canary-44hnn\" (UID: \"90a8562e-b969-4425-9ef3-5d30ac22fe70\") " pod="openshift-ingress-canary/ingress-canary-44hnn"
Jul 02 17:11:20.065864 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.065823    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e33937-2ee1-417e-b72a-d42210ef3239-config-volume\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:20.065864 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.065875    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99g58\" (UniqueName: \"kubernetes.io/projected/f8e33937-2ee1-417e-b72a-d42210ef3239-kube-api-access-99g58\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:20.066121 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.065927    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:20.066121 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.065945    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9bb\" (UniqueName: \"kubernetes.io/projected/90a8562e-b969-4425-9ef3-5d30ac22fe70-kube-api-access-mx9bb\") pod \"ingress-canary-44hnn\" (UID: \"90a8562e-b969-4425-9ef3-5d30ac22fe70\") " pod="openshift-ingress-canary/ingress-canary-44hnn"
Jul 02 17:11:20.066121 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:20.066049    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:20.066121 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.066111    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90a8562e-b969-4425-9ef3-5d30ac22fe70-cert\") pod \"ingress-canary-44hnn\" (UID: \"90a8562e-b969-4425-9ef3-5d30ac22fe70\") " pod="openshift-ingress-canary/ingress-canary-44hnn"
Jul 02 17:11:20.066325 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:20.066125    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:20.566105609 +0000 UTC m=+35.557065849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:20.066325 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.066198    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e33937-2ee1-417e-b72a-d42210ef3239-tmp-dir\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:20.066529 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.066508    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8e33937-2ee1-417e-b72a-d42210ef3239-tmp-dir\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:20.067685 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.067662    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8e33937-2ee1-417e-b72a-d42210ef3239-config-volume\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:20.070788 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.070768    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90a8562e-b969-4425-9ef3-5d30ac22fe70-cert\") pod \"ingress-canary-44hnn\" (UID: \"90a8562e-b969-4425-9ef3-5d30ac22fe70\") " pod="openshift-ingress-canary/ingress-canary-44hnn"
Jul 02 17:11:20.074187 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.074166    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99g58\" (UniqueName: \"kubernetes.io/projected/f8e33937-2ee1-417e-b72a-d42210ef3239-kube-api-access-99g58\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:20.074582 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.074557    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9bb\" (UniqueName: \"kubernetes.io/projected/90a8562e-b969-4425-9ef3-5d30ac22fe70-kube-api-access-mx9bb\") pod \"ingress-canary-44hnn\" (UID: \"90a8562e-b969-4425-9ef3-5d30ac22fe70\") " pod="openshift-ingress-canary/ingress-canary-44hnn"
Jul 02 17:11:20.142999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.142965    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-44hnn"
Jul 02 17:11:20.448367 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.448279    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:20.448542 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.448279    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:20.448542 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.448279    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:20.450699 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.450675    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 17:11:20.450813 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.450788    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 17:11:20.450813 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.450788    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 17:11:20.451438 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.451419    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vg44r\""
Jul 02 17:11:20.451551 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.451453    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 17:11:20.451708 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.451693    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dk9fp\""
Jul 02 17:11:20.570211 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:20.570166    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:20.570385 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:20.570314    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:20.570456 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:20.570406    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:21.570386047 +0000 UTC m=+36.561346293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:21.542580 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:21.542418    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-44hnn"]
Jul 02 17:11:21.550694 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:11:21.550664    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a8562e_b969_4425_9ef3_5d30ac22fe70.slice/crio-e773b62d916f169a74618680b66b6cf62fe6f55f94ba1b63ff2119d9b00a3da0 WatchSource:0}: Error finding container e773b62d916f169a74618680b66b6cf62fe6f55f94ba1b63ff2119d9b00a3da0: Status 404 returned error can't find the container with id e773b62d916f169a74618680b66b6cf62fe6f55f94ba1b63ff2119d9b00a3da0
Jul 02 17:11:21.578924 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:21.578895    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:21.579055 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:21.579016    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:21.579094 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:21.579072    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:23.579055998 +0000 UTC m=+38.570016248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:21.716556 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:21.716519    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-44hnn" event={"ID":"90a8562e-b969-4425-9ef3-5d30ac22fe70","Type":"ContainerStarted","Data":"e773b62d916f169a74618680b66b6cf62fe6f55f94ba1b63ff2119d9b00a3da0"}
Jul 02 17:11:21.719145 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:21.719120    2550 generic.go:356] "Generic (PLEG): container finished" podID="f42b5fdf-69ac-4ce7-bf53-425516d05f89" containerID="50883f01518073bee499df2f9d7ee1a4ec3b8c1b0a477bab50e22fe2f8b8950b" exitCode=0
Jul 02 17:11:21.719263 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:21.719172    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" event={"ID":"f42b5fdf-69ac-4ce7-bf53-425516d05f89","Type":"ContainerDied","Data":"50883f01518073bee499df2f9d7ee1a4ec3b8c1b0a477bab50e22fe2f8b8950b"}
Jul 02 17:11:22.724666 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:22.724635    2550 generic.go:356] "Generic (PLEG): container finished" podID="f42b5fdf-69ac-4ce7-bf53-425516d05f89" containerID="f96c5236a07efdceccacaab3872e12c89dca8012fc8bb89dccd4e3671f08d004" exitCode=0
Jul 02 17:11:22.725024 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:22.724693    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" event={"ID":"f42b5fdf-69ac-4ce7-bf53-425516d05f89","Type":"ContainerDied","Data":"f96c5236a07efdceccacaab3872e12c89dca8012fc8bb89dccd4e3671f08d004"}
Jul 02 17:11:23.593954 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:23.593916    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:23.594177 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:23.594105    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:23.594238 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:23.594184    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:27.594162399 +0000 UTC m=+42.585122649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:23.731851 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:23.731807    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" event={"ID":"f42b5fdf-69ac-4ce7-bf53-425516d05f89","Type":"ContainerStarted","Data":"2fba94963322060e17d27a5c8d5aef5fba1745a95702e05836acfe93e4e948de"}
Jul 02 17:11:23.756218 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:23.756169    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d7d8c" podStartSLOduration=7.731896767 podStartE2EDuration="38.756147812s" totalImagesPullingTime="31.024251045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:23.755156475 +0000 UTC m=+38.746116758" watchObservedRunningTime="2026-07-02 17:11:23.756147812 +0000 UTC m=+38.747108068"
Jul 02 17:11:24.735787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:24.735687    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-44hnn" event={"ID":"90a8562e-b969-4425-9ef3-5d30ac22fe70","Type":"ContainerStarted","Data":"0bfca2d42d6e1c49440b7d5810b410a68839619052c5545dfc16a6f774b2c1ac"}
Jul 02 17:11:24.750519 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:24.750472    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-44hnn" podStartSLOduration=2.870744922 podStartE2EDuration="5.750456625s" totalImagesPullingTime="2.879711703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:24.749616841 +0000 UTC m=+39.740577103" watchObservedRunningTime="2026-07-02 17:11:24.750456625 +0000 UTC m=+39.741416880"
Jul 02 17:11:27.624185 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:27.624143    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:27.624574 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:27.624294    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:27.624574 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:27.624359    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:35.624341974 +0000 UTC m=+50.615302208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:35.676794 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:35.676751    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:35.677253 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:35.676905    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:35.677253 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:35.676980    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:11:51.676963345 +0000 UTC m=+66.667923579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:39.509399 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.509366    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"]
Jul 02 17:11:39.528075 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.528048    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"]
Jul 02 17:11:39.528219 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.528159    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.530101 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.530068    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 17:11:39.530277 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.530206    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 17:11:39.530439 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.530424    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 17:11:39.530506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.530422    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 17:11:39.552279 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.552251    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"]
Jul 02 17:11:39.552279 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.552286    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"]
Jul 02 17:11:39.552481 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.552381    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.554416 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.554395    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 02 17:11:39.554416 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.554412    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 02 17:11:39.554576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.554544    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 02 17:11:39.554576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.554568    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 02 17:11:39.709566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709530    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8r77\" (UniqueName: \"kubernetes.io/projected/cdb9e57b-9a91-423f-a6cd-4bb8af060827-kube-api-access-j8r77\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.709766 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709588    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fba48f3a-ca24-4a66-a036-51cd226841a4-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.709766 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709679    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.709766 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709719    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-hub\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.709863 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709783    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-ca\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.709863 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709847    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sccwb\" (UniqueName: \"kubernetes.io/projected/fba48f3a-ca24-4a66-a036-51cd226841a4-kube-api-access-sccwb\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.709926 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709866    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.709926 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709890    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fba48f3a-ca24-4a66-a036-51cd226841a4-tmp\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.709926 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.709917    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb9e57b-9a91-423f-a6cd-4bb8af060827-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.810924 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.810835    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-ca\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.810924 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.810892    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sccwb\" (UniqueName: \"kubernetes.io/projected/fba48f3a-ca24-4a66-a036-51cd226841a4-kube-api-access-sccwb\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.810924 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.810910    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.811196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.810939    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fba48f3a-ca24-4a66-a036-51cd226841a4-tmp\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.811196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.810957    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb9e57b-9a91-423f-a6cd-4bb8af060827-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.811196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.810973    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8r77\" (UniqueName: \"kubernetes.io/projected/cdb9e57b-9a91-423f-a6cd-4bb8af060827-kube-api-access-j8r77\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.811196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.811014    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fba48f3a-ca24-4a66-a036-51cd226841a4-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.811196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.811037    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.811196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.811054    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-hub\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.811463 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.811417    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fba48f3a-ca24-4a66-a036-51cd226841a4-tmp\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.812166 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.812140    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdb9e57b-9a91-423f-a6cd-4bb8af060827-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.814971 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.814949    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.815085 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.815016    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-ca\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.815085 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.815050    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-hub\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.815197 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.815135    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fba48f3a-ca24-4a66-a036-51cd226841a4-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.815686 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.815665    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cdb9e57b-9a91-423f-a6cd-4bb8af060827-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.819317 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.819293    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8r77\" (UniqueName: \"kubernetes.io/projected/cdb9e57b-9a91-423f-a6cd-4bb8af060827-kube-api-access-j8r77\") pod \"cluster-proxy-proxy-agent-78fc8f864f-l949z\" (UID: \"cdb9e57b-9a91-423f-a6cd-4bb8af060827\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:39.819396 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.819339    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sccwb\" (UniqueName: \"kubernetes.io/projected/fba48f3a-ca24-4a66-a036-51cd226841a4-kube-api-access-sccwb\") pod \"klusterlet-addon-workmgr-7b776c5856-scbcx\" (UID: \"fba48f3a-ca24-4a66-a036-51cd226841a4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.838184 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.838153    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:39.872585 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:39.872548    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:11:40.009174 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:40.009141    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"]
Jul 02 17:11:40.013496 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:11:40.013462    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba48f3a_ca24_4a66_a036_51cd226841a4.slice/crio-378395d833d5c0c347535ec28a248227660d80a432cfe9c0e730a14ddda5d7cc WatchSource:0}: Error finding container 378395d833d5c0c347535ec28a248227660d80a432cfe9c0e730a14ddda5d7cc: Status 404 returned error can't find the container with id 378395d833d5c0c347535ec28a248227660d80a432cfe9c0e730a14ddda5d7cc
Jul 02 17:11:40.037903 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:40.037869    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"]
Jul 02 17:11:40.040733 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:11:40.040703    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdb9e57b_9a91_423f_a6cd_4bb8af060827.slice/crio-be3e7a5597234b71eb8193bf4729597d88c470d61cab73f1aa992cd2dcb1d56c WatchSource:0}: Error finding container be3e7a5597234b71eb8193bf4729597d88c470d61cab73f1aa992cd2dcb1d56c: Status 404 returned error can't find the container with id be3e7a5597234b71eb8193bf4729597d88c470d61cab73f1aa992cd2dcb1d56c
Jul 02 17:11:40.776442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:40.776404    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" event={"ID":"cdb9e57b-9a91-423f-a6cd-4bb8af060827","Type":"ContainerStarted","Data":"be3e7a5597234b71eb8193bf4729597d88c470d61cab73f1aa992cd2dcb1d56c"}
Jul 02 17:11:40.777611 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:40.777569    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx" event={"ID":"fba48f3a-ca24-4a66-a036-51cd226841a4","Type":"ContainerStarted","Data":"378395d833d5c0c347535ec28a248227660d80a432cfe9c0e730a14ddda5d7cc"}
Jul 02 17:11:45.792073 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:45.791980    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" event={"ID":"cdb9e57b-9a91-423f-a6cd-4bb8af060827","Type":"ContainerStarted","Data":"698a6c4d124f966b9c2e66928b29f7a87deaa4741f44415b3946d7158818c048"}
Jul 02 17:11:45.792073 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:45.792030    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" event={"ID":"cdb9e57b-9a91-423f-a6cd-4bb8af060827","Type":"ContainerStarted","Data":"fc27d38c5f274c4048bd9d5c7272a3bfa85d07c4c557f78f51d9894d1c998bbd"}
Jul 02 17:11:45.792073 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:45.792048    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" event={"ID":"cdb9e57b-9a91-423f-a6cd-4bb8af060827","Type":"ContainerStarted","Data":"98411a7e0999449b9ba6f5f6c7984a713b526818bb542e1e4e689fa4d14b11b4"}
Jul 02 17:11:45.793476 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:45.793451    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx" event={"ID":"fba48f3a-ca24-4a66-a036-51cd226841a4","Type":"ContainerStarted","Data":"09460adf2966ed4480a88cc8299006fbda2f8c44c0a52b1859d1b761eaf9ef7b"}
Jul 02 17:11:45.793662 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:45.793650    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:45.795331 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:45.795313    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:11:45.811256 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:45.811200    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" podStartSLOduration=1.449161717 podStartE2EDuration="6.811182368s" totalImagesPullingTime="5.362020651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:45.810252824 +0000 UTC m=+60.801213078" watchObservedRunningTime="2026-07-02 17:11:45.811182368 +0000 UTC m=+60.802142601"
Jul 02 17:11:45.825790 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:45.825746    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx" podStartSLOduration=1.438040876 podStartE2EDuration="6.825730719s" totalImagesPullingTime="5.387689843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:45.825034655 +0000 UTC m=+60.815994929" watchObservedRunningTime="2026-07-02 17:11:45.825730719 +0000 UTC m=+60.816690973"
Jul 02 17:11:46.718265 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:46.718234    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6cxx"
Jul 02 17:11:50.188445 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.188391    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:50.189198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.188499    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:11:50.190903 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.190884    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 17:11:50.190957 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.190901    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 17:11:50.199435 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:50.199404    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 17:11:50.199485 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:50.199479    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:12:54.199462071 +0000 UTC m=+129.190422304 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : secret "metrics-daemon-secret" not found
Jul 02 17:11:50.201777 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.201743    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f43ef34-2095-452e-9da1-b557b4ac5d11-original-pull-secret\") pod \"global-pull-secret-syncer-j9gxg\" (UID: \"1f43ef34-2095-452e-9da1-b557b4ac5d11\") " pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:50.390815 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.390781    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:50.393145 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.393128    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 17:11:50.404017 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.403995    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 17:11:50.415193 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.415165    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfn98\" (UniqueName: \"kubernetes.io/projected/3a31ca9f-839f-421f-9572-b8d6477e1496-kube-api-access-dfn98\") pod \"network-check-target-nl2sk\" (UID: \"3a31ca9f-839f-421f-9572-b8d6477e1496\") " pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:50.459625 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.459512    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j9gxg"
Jul 02 17:11:50.474399 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.474357    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dk9fp\""
Jul 02 17:11:50.482187 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.482161    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:50.594171 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.594142    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j9gxg"]
Jul 02 17:11:50.597492 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:11:50.597464    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f43ef34_2095_452e_9da1_b557b4ac5d11.slice/crio-1787a1e95b9e7f7c06b6247192737171a2cb1913657de8ff723ab67ebbe0d9ac WatchSource:0}: Error finding container 1787a1e95b9e7f7c06b6247192737171a2cb1913657de8ff723ab67ebbe0d9ac: Status 404 returned error can't find the container with id 1787a1e95b9e7f7c06b6247192737171a2cb1913657de8ff723ab67ebbe0d9ac
Jul 02 17:11:50.614764 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.614737    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nl2sk"]
Jul 02 17:11:50.617918 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:11:50.617889    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a31ca9f_839f_421f_9572_b8d6477e1496.slice/crio-45fcfdf0f30e2bb18f9415d5e140484a8b63497372a60abcd4d46ff9966ea3ee WatchSource:0}: Error finding container 45fcfdf0f30e2bb18f9415d5e140484a8b63497372a60abcd4d46ff9966ea3ee: Status 404 returned error can't find the container with id 45fcfdf0f30e2bb18f9415d5e140484a8b63497372a60abcd4d46ff9966ea3ee
Jul 02 17:11:50.808140 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.808053    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j9gxg" event={"ID":"1f43ef34-2095-452e-9da1-b557b4ac5d11","Type":"ContainerStarted","Data":"1787a1e95b9e7f7c06b6247192737171a2cb1913657de8ff723ab67ebbe0d9ac"}
Jul 02 17:11:50.809197 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:50.809173    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nl2sk" event={"ID":"3a31ca9f-839f-421f-9572-b8d6477e1496","Type":"ContainerStarted","Data":"45fcfdf0f30e2bb18f9415d5e140484a8b63497372a60abcd4d46ff9966ea3ee"}
Jul 02 17:11:51.701435 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:51.701398    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:11:51.701916 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:51.701519    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:11:51.701916 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:11:51.701575    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:12:23.701560643 +0000 UTC m=+98.692520881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:11:54.828384 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:54.828338    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nl2sk" event={"ID":"3a31ca9f-839f-421f-9572-b8d6477e1496","Type":"ContainerStarted","Data":"d116b0ad90ad89eb1bd1fea27937dbba6f8c08a984216612fa29cbc8e74bd4ca"}
Jul 02 17:11:54.828843 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:54.828479    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:11:54.844836 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:54.844776    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nl2sk" podStartSLOduration=66.674416908 podStartE2EDuration="1m9.84475475s" totalImagesPullingTime="3.170337842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:54.843810755 +0000 UTC m=+69.834771038" watchObservedRunningTime="2026-07-02 17:11:54.84475475 +0000 UTC m=+69.835715006"
Jul 02 17:11:55.833092 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:55.833056    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j9gxg" event={"ID":"1f43ef34-2095-452e-9da1-b557b4ac5d11","Type":"ContainerStarted","Data":"8161f281d0e19b95e1b8549b03a5f9caa66cda95555fc93cb2d245ac09ef6324"}
Jul 02 17:11:56.852709 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:11:56.852653    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j9gxg" podStartSLOduration=66.773754765 podStartE2EDuration="1m11.85263757s" totalImagesPullingTime="5.078882805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:11:56.852084466 +0000 UTC m=+71.843044721" watchObservedRunningTime="2026-07-02 17:11:56.85263757 +0000 UTC m=+71.843597824"
Jul 02 17:12:23.726111 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:12:23.726066    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:12:23.726867 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:12:23.726216    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:12:23.726867 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:12:23.726306    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:13:27.726286785 +0000 UTC m=+162.717247033 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:12:25.835725 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:12:25.835692    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nl2sk"
Jul 02 17:12:54.237828 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:12:54.237781    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:12:54.238313 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:12:54.237939    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 17:12:54.238313 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:12:54.238031    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:14:56.238015472 +0000 UTC m=+251.228975710 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : secret "metrics-daemon-secret" not found
Jul 02 17:13:22.838748 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:13:22.838706    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zprb9" podUID="f8e33937-2ee1-417e-b72a-d42210ef3239"
Jul 02 17:13:23.079680 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:23.079652    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zprb9"
Jul 02 17:13:23.466402 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:13:23.466367    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:13:27.778351 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:27.778296    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:13:27.778768 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:13:27.778438    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 17:13:27.778768 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:13:27.778493    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls podName:f8e33937-2ee1-417e-b72a-d42210ef3239 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:29.778479645 +0000 UTC m=+284.769439881 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls") pod "dns-default-zprb9" (UID: "f8e33937-2ee1-417e-b72a-d42210ef3239") : secret "dns-default-metrics-tls" not found
Jul 02 17:13:35.451914 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:35.451884    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:13:45.794323 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:45.794207    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx" podUID="fba48f3a-ca24-4a66-a036-51cd226841a4" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 02 17:13:46.148055 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:46.148019    2550 generic.go:356] "Generic (PLEG): container finished" podID="fba48f3a-ca24-4a66-a036-51cd226841a4" containerID="09460adf2966ed4480a88cc8299006fbda2f8c44c0a52b1859d1b761eaf9ef7b" exitCode=1
Jul 02 17:13:46.148264 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:46.148071    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx" event={"ID":"fba48f3a-ca24-4a66-a036-51cd226841a4","Type":"ContainerDied","Data":"09460adf2966ed4480a88cc8299006fbda2f8c44c0a52b1859d1b761eaf9ef7b"}
Jul 02 17:13:46.148491 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:46.148472    2550 scope.go:117] "RemoveContainer" containerID="09460adf2966ed4480a88cc8299006fbda2f8c44c0a52b1859d1b761eaf9ef7b"
Jul 02 17:13:47.152996 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:47.152956    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx" event={"ID":"fba48f3a-ca24-4a66-a036-51cd226841a4","Type":"ContainerStarted","Data":"8aac062b0e0203018717bbd0ae6ff09dae646a4ff2844e3c60d954bed1b5fc1b"}
Jul 02 17:13:47.153462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:47.153256    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:13:47.153873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:13:47.153855    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b776c5856-scbcx"
Jul 02 17:14:46.558257 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.558222    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kp86h"]
Jul 02 17:14:46.560149 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.560133    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.562563 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.562542    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 17:14:46.563031 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.563012    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 17:14:46.563198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.563186    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 17:14:46.563573 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.563556    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hjnd2\""
Jul 02 17:14:46.563668 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.563558    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 17:14:46.586190 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.586161    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kp86h"]
Jul 02 17:14:46.728500 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.728461    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98bdd55e-42b1-40da-b91f-f13c72a0f375-data-volume\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.728679 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.728512    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhn8d\" (UniqueName: \"kubernetes.io/projected/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-api-access-lhn8d\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.728679 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.728557    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.728753 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.728686    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98bdd55e-42b1-40da-b91f-f13c72a0f375-crio-socket\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.728753 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.728704    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.829771 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.829694    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98bdd55e-42b1-40da-b91f-f13c72a0f375-crio-socket\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.829771 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.829737    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.829985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.829774    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98bdd55e-42b1-40da-b91f-f13c72a0f375-data-volume\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.829985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.829796    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhn8d\" (UniqueName: \"kubernetes.io/projected/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-api-access-lhn8d\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.829985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.829823    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.829985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.829829    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98bdd55e-42b1-40da-b91f-f13c72a0f375-crio-socket\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.829985 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:46.829917    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:46.830224 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:46.830010    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:47.329989895 +0000 UTC m=+242.320950143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:46.830224 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:46.830036    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:46.830224 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:46.830076    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:47.330064066 +0000 UTC m=+242.321024299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:46.830224 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.830181    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98bdd55e-42b1-40da-b91f-f13c72a0f375-data-volume\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:46.864176 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:46.864138    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhn8d\" (UniqueName: \"kubernetes.io/projected/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-api-access-lhn8d\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:47.333677 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:47.333637    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:47.333873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:47.333699    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:47.333873 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:47.333767    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:47.333873 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:47.333789    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:47.333873 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:47.333819    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:48.333805418 +0000 UTC m=+243.324765651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:47.333873 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:47.333850    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:48.333836269 +0000 UTC m=+243.324796503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:48.310524 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:48.310487    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kmsf9_499a1f52-1802-42a4-b958-40b25212a692/dns-node-resolver/0.log"
Jul 02 17:14:48.342706 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:48.342663    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:48.342884 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:48.342747    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:48.342884 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:48.342807    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:48.343004 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:48.342890    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:48.343004 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:48.342907    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:50.342885044 +0000 UTC m=+245.333845288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:48.343004 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:48.342950    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:50.342933558 +0000 UTC m=+245.333893792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:49.312687 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:49.312653    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9gjcr_1edae93b-ecb6-40fc-91a1-5ef01b981e95/node-ca/0.log"
Jul 02 17:14:50.111428 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:50.111393    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-44hnn_90a8562e-b969-4425-9ef3-5d30ac22fe70/serve-healthcheck-canary/0.log"
Jul 02 17:14:50.356968 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:50.356925    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:50.357351 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:50.356990    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:50.357351 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:50.357051    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:50.357351 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:50.357087    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:50.357351 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:50.357120    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:54.35710201 +0000 UTC m=+249.348062260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:50.357351 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:50.357138    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:14:54.357126913 +0000 UTC m=+249.348087146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:54.387674 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:54.387633    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:54.388166 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:54.387705    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:14:54.388166 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:54.387780    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:54.388166 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:54.387819    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 17:14:54.388166 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:54.387852    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:02.387837246 +0000 UTC m=+257.378797479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : secret "insights-runtime-extractor-tls" not found
Jul 02 17:14:54.388166 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:54.387867    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm podName:98bdd55e-42b1-40da-b91f-f13c72a0f375 nodeName:}" failed. No retries permitted until 2026-07-02 17:15:02.387861089 +0000 UTC m=+257.378821322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kp86h" (UID: "98bdd55e-42b1-40da-b91f-f13c72a0f375") : configmap "kube-rbac-proxy" not found
Jul 02 17:14:56.302785 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:14:56.302740    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:14:56.303173 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:56.302907    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 17:14:56.303173 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:14:56.302982    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs podName:19f0cb34-ac3a-4521-bc54-c453c6db705c nodeName:}" failed. No retries permitted until 2026-07-02 17:16:58.302966344 +0000 UTC m=+373.293926577 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs") pod "network-metrics-daemon-8npvm" (UID: "19f0cb34-ac3a-4521-bc54-c453c6db705c") : secret "metrics-daemon-secret" not found
Jul 02 17:15:02.451317 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:02.451278    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:15:02.451814 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:02.451336    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:15:02.451886 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:02.451868    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98bdd55e-42b1-40da-b91f-f13c72a0f375-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:15:02.453664 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:02.453638    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98bdd55e-42b1-40da-b91f-f13c72a0f375-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp86h\" (UID: \"98bdd55e-42b1-40da-b91f-f13c72a0f375\") " pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:15:02.468626 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:02.468584    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kp86h"
Jul 02 17:15:02.594356 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:02.594314    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kp86h"]
Jul 02 17:15:02.598068 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:15:02.598035    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bdd55e_42b1_40da_b91f_f13c72a0f375.slice/crio-0fe4b3eceb4d8e1b0737e5cb64982e5dec295ed23e6407bbcf34aae30c1d8832 WatchSource:0}: Error finding container 0fe4b3eceb4d8e1b0737e5cb64982e5dec295ed23e6407bbcf34aae30c1d8832: Status 404 returned error can't find the container with id 0fe4b3eceb4d8e1b0737e5cb64982e5dec295ed23e6407bbcf34aae30c1d8832
Jul 02 17:15:03.372553 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:03.372511    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kp86h" event={"ID":"98bdd55e-42b1-40da-b91f-f13c72a0f375","Type":"ContainerStarted","Data":"0fe4b3eceb4d8e1b0737e5cb64982e5dec295ed23e6407bbcf34aae30c1d8832"}
Jul 02 17:15:06.383659 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:06.383625    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kp86h" event={"ID":"98bdd55e-42b1-40da-b91f-f13c72a0f375","Type":"ContainerStarted","Data":"64d963bdfa0b687cb646ba79af6e4dc24e2160db5855d1d39e59121ef21c789f"}
Jul 02 17:15:07.387805 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:07.387766    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kp86h" event={"ID":"98bdd55e-42b1-40da-b91f-f13c72a0f375","Type":"ContainerStarted","Data":"353f2db11d6daffe8ae6d0a144d67ae1a645f62383b65c2eae6499e1a0bbd08e"}
Jul 02 17:15:10.399156 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:10.399120    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kp86h" event={"ID":"98bdd55e-42b1-40da-b91f-f13c72a0f375","Type":"ContainerStarted","Data":"690123d14ae95597118594f5b01e06b1e48e78ea1f75fde0d2669ca9706bde5b"}
Jul 02 17:15:10.416272 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:10.416195    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kp86h" podStartSLOduration=17.631518601 podStartE2EDuration="24.41617663s" totalImagesPullingTime="6.784658029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:14:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:10.415975636 +0000 UTC m=+265.406935890" watchObservedRunningTime="2026-07-02 17:15:10.41617663 +0000 UTC m=+265.407136886"
Jul 02 17:15:12.936141 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.936107    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55984c446d-wn4rb"]
Jul 02 17:15:12.938182 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.938161    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:12.939988 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.939965    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 17:15:12.940085 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.939965    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 17:15:12.941245 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.941211    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 17:15:12.941382 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.941330    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 17:15:12.941540 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.941524    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 17:15:12.941664 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.941607    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pcl4h\""
Jul 02 17:15:12.941838 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.941820    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 17:15:12.941905 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.941824    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 17:15:12.950817 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:12.950792    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55984c446d-wn4rb"]
Jul 02 17:15:13.025858 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.025817    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-service-ca\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.025858 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.025866    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-oauth-serving-cert\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.026054 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.025928    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-serving-cert\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.026054 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.025949    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqfqq\" (UniqueName: \"kubernetes.io/projected/a0bb736e-cdc6-4904-b9a3-e23281a3a148-kube-api-access-jqfqq\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.026054 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.026003    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-oauth-config\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.026054 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.026021    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-config\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.127347 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.127309    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-oauth-serving-cert\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.127540 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.127370    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-serving-cert\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.127540 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.127393    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfqq\" (UniqueName: \"kubernetes.io/projected/a0bb736e-cdc6-4904-b9a3-e23281a3a148-kube-api-access-jqfqq\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.127540 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.127443    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-oauth-config\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.127540 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.127498    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-config\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.127787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.127549    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-service-ca\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.128203 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.128181    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-config\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.128309 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.128180    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-oauth-serving-cert\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.128309 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.128227    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-service-ca\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.129889 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.129865    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-serving-cert\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.129983 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.129958    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-oauth-config\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.135220 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.135194    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqfqq\" (UniqueName: \"kubernetes.io/projected/a0bb736e-cdc6-4904-b9a3-e23281a3a148-kube-api-access-jqfqq\") pod \"console-55984c446d-wn4rb\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") " pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.247818 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.247729    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:13.368658 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.368626    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55984c446d-wn4rb"]
Jul 02 17:15:13.371747 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:15:13.371716    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0bb736e_cdc6_4904_b9a3_e23281a3a148.slice/crio-873f9a05e87b21c1fa2c71cf29c222178abffffea446c3dfa9ede3ee119e74d4 WatchSource:0}: Error finding container 873f9a05e87b21c1fa2c71cf29c222178abffffea446c3dfa9ede3ee119e74d4: Status 404 returned error can't find the container with id 873f9a05e87b21c1fa2c71cf29c222178abffffea446c3dfa9ede3ee119e74d4
Jul 02 17:15:13.408823 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:13.408787    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55984c446d-wn4rb" event={"ID":"a0bb736e-cdc6-4904-b9a3-e23281a3a148","Type":"ContainerStarted","Data":"873f9a05e87b21c1fa2c71cf29c222178abffffea446c3dfa9ede3ee119e74d4"}
Jul 02 17:15:16.359759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:16.359723    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"]
Jul 02 17:15:16.366374 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:16.366353    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"
Jul 02 17:15:16.368289 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:16.368263    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 17:15:16.368631 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:16.368548    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6px7h\""
Jul 02 17:15:16.368806 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:16.368778    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"]
Jul 02 17:15:16.451340 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:16.451306    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-t4779\" (UID: \"db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"
Jul 02 17:15:16.551707 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:16.551680    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-t4779\" (UID: \"db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"
Jul 02 17:15:16.551873 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:16.551851    2550 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 17:15:16.551938 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:16.551927    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c-tls-certificates podName:db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c nodeName:}" failed. No retries permitted until 2026-07-02 17:15:17.051908612 +0000 UTC m=+272.042868861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-t4779" (UID: "db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 17:15:17.056266 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:17.056216    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-t4779\" (UID: \"db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"
Jul 02 17:15:17.058604 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:17.058554    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-t4779\" (UID: \"db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"
Jul 02 17:15:17.277686 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:17.277647    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"
Jul 02 17:15:17.399007 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:17.398804    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"]
Jul 02 17:15:17.401885 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:15:17.401860    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7f135f_7a29_49ec_8dcd_56e9b3dc5c2c.slice/crio-20dc383aecb7e6c887e15b4f5e3010c6b99ad167f943fe59f15cd3c73309ef5b WatchSource:0}: Error finding container 20dc383aecb7e6c887e15b4f5e3010c6b99ad167f943fe59f15cd3c73309ef5b: Status 404 returned error can't find the container with id 20dc383aecb7e6c887e15b4f5e3010c6b99ad167f943fe59f15cd3c73309ef5b
Jul 02 17:15:17.422317 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:17.422285    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779" event={"ID":"db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c","Type":"ContainerStarted","Data":"20dc383aecb7e6c887e15b4f5e3010c6b99ad167f943fe59f15cd3c73309ef5b"}
Jul 02 17:15:17.423785 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:17.423759    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55984c446d-wn4rb" event={"ID":"a0bb736e-cdc6-4904-b9a3-e23281a3a148","Type":"ContainerStarted","Data":"d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534"}
Jul 02 17:15:17.438509 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:17.438461    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55984c446d-wn4rb" podStartSLOduration=2.313128628 podStartE2EDuration="5.438443684s" totalImagesPullingTime="3.125315056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:17.437546408 +0000 UTC m=+272.428506673" watchObservedRunningTime="2026-07-02 17:15:17.438443684 +0000 UTC m=+272.429403982"
Jul 02 17:15:17.998729 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:17.998687    2550 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cbb4f246e23a8e2ba40942a548233ccbfb90a82ae419c76f21e44b89e9400b4a"
Jul 02 17:15:17.998906 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:17.998798    2550 kuberuntime_manager.go:1459] "Unhandled Error" err="container prometheus-operator-admission-webhook start failed in pod prometheus-operator-admission-webhook-7ddc8784d4-t4779_openshift-monitoring(db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 02 17:15:17.998906 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:17.998829    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"prometheus-operator-admission-webhook\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779" podUID="db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c"
Jul 02 17:15:18.428403 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:18.428374    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"prometheus-operator-admission-webhook\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cbb4f246e23a8e2ba40942a548233ccbfb90a82ae419c76f21e44b89e9400b4a\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779" podUID="db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c"
Jul 02 17:15:23.248014 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:23.247973    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:23.248623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:23.248053    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:15:23.249533 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:23.249507    2550 patch_prober.go:28] interesting pod/console-55984c446d-wn4rb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body=
Jul 02 17:15:23.249639 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:23.249552    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-55984c446d-wn4rb" podUID="a0bb736e-cdc6-4904-b9a3-e23281a3a148" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused"
Jul 02 17:15:26.080411 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:26.080371    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zprb9" podUID="f8e33937-2ee1-417e-b72a-d42210ef3239"
Jul 02 17:15:26.451110 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:26.451083    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zprb9"
Jul 02 17:15:29.850816 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:29.850778    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:15:29.853066 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:29.853043    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8e33937-2ee1-417e-b72a-d42210ef3239-metrics-tls\") pod \"dns-default-zprb9\" (UID: \"f8e33937-2ee1-417e-b72a-d42210ef3239\") " pod="openshift-dns/dns-default-zprb9"
Jul 02 17:15:29.874185 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:29.874138    2550 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" podUID="cdb9e57b-9a91-423f-a6cd-4bb8af060827" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 02 17:15:30.054250 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:30.054217    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wfcqg\""
Jul 02 17:15:30.062697 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:30.062672    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zprb9"
Jul 02 17:15:30.322793 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:30.322669    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zprb9"]
Jul 02 17:15:30.325209 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:15:30.325178    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e33937_2ee1_417e_b72a_d42210ef3239.slice/crio-f12a42e8f7ce089c490743911b6391831c6cfa480f1e652ba3415b57073a3b37 WatchSource:0}: Error finding container f12a42e8f7ce089c490743911b6391831c6cfa480f1e652ba3415b57073a3b37: Status 404 returned error can't find the container with id f12a42e8f7ce089c490743911b6391831c6cfa480f1e652ba3415b57073a3b37
Jul 02 17:15:30.464956 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:30.464866    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zprb9" event={"ID":"f8e33937-2ee1-417e-b72a-d42210ef3239","Type":"ContainerStarted","Data":"f12a42e8f7ce089c490743911b6391831c6cfa480f1e652ba3415b57073a3b37"}
Jul 02 17:15:33.248857 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:33.248822    2550 patch_prober.go:28] interesting pod/console-55984c446d-wn4rb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body=
Jul 02 17:15:33.249226 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:33.248885    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-55984c446d-wn4rb" podUID="a0bb736e-cdc6-4904-b9a3-e23281a3a148" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused"
Jul 02 17:15:33.475170 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:33.475138    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zprb9" event={"ID":"f8e33937-2ee1-417e-b72a-d42210ef3239","Type":"ContainerStarted","Data":"8c9e0e292b966145031babd13201fadcb4fb7df3513590c56ec8831d8342eba5"}
Jul 02 17:15:33.475401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:33.475187    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zprb9" event={"ID":"f8e33937-2ee1-417e-b72a-d42210ef3239","Type":"ContainerStarted","Data":"eac9bb28d79074533d0fce05df6a869e77204b2031871da5b7eb7853c7514c38"}
Jul 02 17:15:33.475401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:33.475217    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zprb9"
Jul 02 17:15:33.506269 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:33.506165    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zprb9" podStartSLOduration=252.470756841 podStartE2EDuration="4m14.506140337s" totalImagesPullingTime="2.035383496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:33.506020631 +0000 UTC m=+288.496980918" watchObservedRunningTime="2026-07-02 17:15:33.506140337 +0000 UTC m=+288.497100593"
Jul 02 17:15:35.483473 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:35.483431    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779" event={"ID":"db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c","Type":"ContainerStarted","Data":"5bef05cb86a7ac3a0fce42f80a5501d06fa88cd05b570b40af35164d3ef1cdd1"}
Jul 02 17:15:35.483954 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:35.483721    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"
Jul 02 17:15:35.488338 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:35.488317    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779"
Jul 02 17:15:35.499677 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:35.499636    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-t4779" podStartSLOduration=2.109997094 podStartE2EDuration="19.499622599s" totalImagesPullingTime="17.389625505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 17:15:35.498808715 +0000 UTC m=+290.489768985" watchObservedRunningTime="2026-07-02 17:15:35.499622599 +0000 UTC m=+290.490582848"
Jul 02 17:15:38.452643 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:38.452575    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8npvm" podUID="19f0cb34-ac3a-4521-bc54-c453c6db705c"
Jul 02 17:15:39.873918 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:39.873883    2550 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" podUID="cdb9e57b-9a91-423f-a6cd-4bb8af060827" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 02 17:15:42.235841 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.235813    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55984c446d-wn4rb"]
Jul 02 17:15:42.795676 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.795644    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gljqs"]
Jul 02 17:15:42.797847 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.797830    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.800098 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.800071    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 17:15:42.800098 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.800086    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 17:15:42.800272 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.800082    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 17:15:42.800272 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.800071    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 17:15:42.800518 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.800505    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xq4xm\""
Jul 02 17:15:42.800604 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.800528    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 17:15:42.801293 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.801258    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 17:15:42.844427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844393    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4df92017-7195-484f-aad5-481d50108bfc-metrics-client-ca\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.844623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844435    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5dc6\" (UniqueName: \"kubernetes.io/projected/4df92017-7195-484f-aad5-481d50108bfc-kube-api-access-l5dc6\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.844623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844451    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-sys\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.844623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844477    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-wtmp\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.844623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844539    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-tls\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.844623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844571    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.844623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844608    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-accelerators-collector-config\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.844849 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844634    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-textfile\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.844849 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.844701    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-root\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945238 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945198    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4df92017-7195-484f-aad5-481d50108bfc-metrics-client-ca\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945247    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5dc6\" (UniqueName: \"kubernetes.io/projected/4df92017-7195-484f-aad5-481d50108bfc-kube-api-access-l5dc6\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945274    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-sys\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945300    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-wtmp\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945334    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-tls\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945358    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945418    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-sys\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945777 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945470    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-accelerators-collector-config\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945777 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945477    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-wtmp\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945777 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945548    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-textfile\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945777 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945631    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-root\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945777 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945714    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4df92017-7195-484f-aad5-481d50108bfc-root\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.945958 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945942    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-textfile\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.946002 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945945    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4df92017-7195-484f-aad5-481d50108bfc-metrics-client-ca\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.946037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.945998    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-accelerators-collector-config\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.947760 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.947732    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.947884 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.947763    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4df92017-7195-484f-aad5-481d50108bfc-node-exporter-tls\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:42.952486 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:42.952465    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5dc6\" (UniqueName: \"kubernetes.io/projected/4df92017-7195-484f-aad5-481d50108bfc-kube-api-access-l5dc6\") pod \"node-exporter-gljqs\" (UID: \"4df92017-7195-484f-aad5-481d50108bfc\") " pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:43.107420 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:43.107335    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gljqs"
Jul 02 17:15:43.117657 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:15:43.117621    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df92017_7195_484f_aad5_481d50108bfc.slice/crio-eebf34170f0b37efdbcf0622e5f3f706d88269d3f5425b52e37d3d0e2addce32 WatchSource:0}: Error finding container eebf34170f0b37efdbcf0622e5f3f706d88269d3f5425b52e37d3d0e2addce32: Status 404 returned error can't find the container with id eebf34170f0b37efdbcf0622e5f3f706d88269d3f5425b52e37d3d0e2addce32
Jul 02 17:15:43.480939 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:43.480912    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zprb9"
Jul 02 17:15:43.512612 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:43.512559    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gljqs" event={"ID":"4df92017-7195-484f-aad5-481d50108bfc","Type":"ContainerStarted","Data":"eebf34170f0b37efdbcf0622e5f3f706d88269d3f5425b52e37d3d0e2addce32"}
Jul 02 17:15:44.516876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.516838    2550 generic.go:356] "Generic (PLEG): container finished" podID="4df92017-7195-484f-aad5-481d50108bfc" containerID="f38fc32cea130ffbaaf1ff420cc5e70d76f597bc58709c84311cd9a3cf067dc4" exitCode=0
Jul 02 17:15:44.517295 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.516903    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gljqs" event={"ID":"4df92017-7195-484f-aad5-481d50108bfc","Type":"ContainerDied","Data":"f38fc32cea130ffbaaf1ff420cc5e70d76f597bc58709c84311cd9a3cf067dc4"}
Jul 02 17:15:44.861112 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.861033    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74c894c97d-g6wg2"]
Jul 02 17:15:44.863286 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.863268    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:44.865418 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.865398    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 17:15:44.865546 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.865517    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 17:15:44.865546 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.865534    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 17:15:44.865681 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.865536    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8tc1mdcaaisck\""
Jul 02 17:15:44.865681 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.865575    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 17:15:44.865781 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.865732    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 17:15:44.865845 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.865800    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dsgsp\""
Jul 02 17:15:44.874045 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.874024    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74c894c97d-g6wg2"]
Jul 02 17:15:44.962310 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.962265    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:44.962310 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.962312    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:44.962565 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.962343    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-tls\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:44.962565 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.962366    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:44.962565 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.962420    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-grpc-tls\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:44.962565 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.962441    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94f49\" (UniqueName: \"kubernetes.io/projected/d93eabfc-f5b1-4b09-a924-f8f22e648816-kube-api-access-94f49\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:44.962565 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.962484    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93eabfc-f5b1-4b09-a924-f8f22e648816-metrics-client-ca\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:44.962565 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:44.962535    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.063832 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.063796    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-grpc-tls\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.063832 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.063834    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94f49\" (UniqueName: \"kubernetes.io/projected/d93eabfc-f5b1-4b09-a924-f8f22e648816-kube-api-access-94f49\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.064039 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.063860    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93eabfc-f5b1-4b09-a924-f8f22e648816-metrics-client-ca\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.064039 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.063940    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.064039 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.063997    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.064039 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.064028    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.064240 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.064058    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-tls\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.064240 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.064085    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.064514 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.064486    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93eabfc-f5b1-4b09-a924-f8f22e648816-metrics-client-ca\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.066537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.066511    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.066758 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.066740    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-grpc-tls\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.066985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.066962    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.067024 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.066990    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.067076 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.067060    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.067268 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.067246    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d93eabfc-f5b1-4b09-a924-f8f22e648816-secret-thanos-querier-tls\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.073258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.073235    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94f49\" (UniqueName: \"kubernetes.io/projected/d93eabfc-f5b1-4b09-a924-f8f22e648816-kube-api-access-94f49\") pod \"thanos-querier-74c894c97d-g6wg2\" (UID: \"d93eabfc-f5b1-4b09-a924-f8f22e648816\") " pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.172308 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.172266    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:45.326679 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.326651    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74c894c97d-g6wg2"]
Jul 02 17:15:45.328815 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:15:45.328788    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93eabfc_f5b1_4b09_a924_f8f22e648816.slice/crio-c94274db284f6e1aff7a1f137d71cb066f274d435ebd59306a5fbab82b833e08 WatchSource:0}: Error finding container c94274db284f6e1aff7a1f137d71cb066f274d435ebd59306a5fbab82b833e08: Status 404 returned error can't find the container with id c94274db284f6e1aff7a1f137d71cb066f274d435ebd59306a5fbab82b833e08
Jul 02 17:15:45.409916 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.409888    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:15:45.410442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.410418    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:15:45.412453 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.412434    2550 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 17:15:45.521367 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.521140    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gljqs" event={"ID":"4df92017-7195-484f-aad5-481d50108bfc","Type":"ContainerStarted","Data":"7162d750135fc6851a69be9dfa7ea5569ac2e446e1843b6ee0b8282126d979e0"}
Jul 02 17:15:45.521367 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.521207    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gljqs" event={"ID":"4df92017-7195-484f-aad5-481d50108bfc","Type":"ContainerStarted","Data":"a00d1edb077b859a8fba1740a47560918804a538aa685e041580b49c3b4c4059"}
Jul 02 17:15:45.532446 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.522093    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2" event={"ID":"d93eabfc-f5b1-4b09-a924-f8f22e648816","Type":"ContainerStarted","Data":"c94274db284f6e1aff7a1f137d71cb066f274d435ebd59306a5fbab82b833e08"}
Jul 02 17:15:45.540539 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:45.540491    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gljqs" podStartSLOduration=2.562548252 podStartE2EDuration="3.540475903s" totalImagesPullingTime="912.66559ms" totalInitContainerRuntime="65.262061ms" isStatefulPod=true podCreationTimestamp="2026-07-02 17:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:45.539797526 +0000 UTC m=+300.530757782" watchObservedRunningTime="2026-07-02 17:15:45.540475903 +0000 UTC m=+300.531436158"
Jul 02 17:15:47.573118 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.573082    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"]
Jul 02 17:15:47.575692 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.575667    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:47.578119 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.578093    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 02 17:15:47.578493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.578474    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xbblx\""
Jul 02 17:15:47.587393 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.587371    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"]
Jul 02 17:15:47.685180 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.685141    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d008f36-b1b6-42fc-8792-083acd49db0d-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-45pgl\" (UID: \"1d008f36-b1b6-42fc-8792-083acd49db0d\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:47.685370 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.685273    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfcvz\" (UniqueName: \"kubernetes.io/projected/1d008f36-b1b6-42fc-8792-083acd49db0d-kube-api-access-xfcvz\") pod \"monitoring-plugin-cd8656b8-45pgl\" (UID: \"1d008f36-b1b6-42fc-8792-083acd49db0d\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:47.786360 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.786324    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d008f36-b1b6-42fc-8792-083acd49db0d-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-45pgl\" (UID: \"1d008f36-b1b6-42fc-8792-083acd49db0d\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:47.786544 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.786444    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfcvz\" (UniqueName: \"kubernetes.io/projected/1d008f36-b1b6-42fc-8792-083acd49db0d-kube-api-access-xfcvz\") pod \"monitoring-plugin-cd8656b8-45pgl\" (UID: \"1d008f36-b1b6-42fc-8792-083acd49db0d\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:47.786544 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:47.786502    2550 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 02 17:15:47.786688 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:15:47.786603    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d008f36-b1b6-42fc-8792-083acd49db0d-monitoring-plugin-cert podName:1d008f36-b1b6-42fc-8792-083acd49db0d nodeName:}" failed. No retries permitted until 2026-07-02 17:15:48.286562315 +0000 UTC m=+303.277522564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1d008f36-b1b6-42fc-8792-083acd49db0d-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-45pgl" (UID: "1d008f36-b1b6-42fc-8792-083acd49db0d") : secret "monitoring-plugin-cert" not found
Jul 02 17:15:47.795695 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:47.795664    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfcvz\" (UniqueName: \"kubernetes.io/projected/1d008f36-b1b6-42fc-8792-083acd49db0d-kube-api-access-xfcvz\") pod \"monitoring-plugin-cd8656b8-45pgl\" (UID: \"1d008f36-b1b6-42fc-8792-083acd49db0d\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:48.202280 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:48.202257    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:15:48.291775 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:48.291687    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d008f36-b1b6-42fc-8792-083acd49db0d-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-45pgl\" (UID: \"1d008f36-b1b6-42fc-8792-083acd49db0d\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:48.294210 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:48.294175    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d008f36-b1b6-42fc-8792-083acd49db0d-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-45pgl\" (UID: \"1d008f36-b1b6-42fc-8792-083acd49db0d\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:48.487432 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:48.487393    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:48.537693 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:48.537663    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2" event={"ID":"d93eabfc-f5b1-4b09-a924-f8f22e648816","Type":"ContainerStarted","Data":"9bc0ba8f53c3d8b9fef4c8dab297d508ad63cabaea66cd2dd0e141d183ec4ef6"}
Jul 02 17:15:48.537800 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:48.537759    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2" event={"ID":"d93eabfc-f5b1-4b09-a924-f8f22e648816","Type":"ContainerStarted","Data":"1ac1bd3e9670dce6333630f7026c23ee3516797a00c099444befcf6a8fe5ba47"}
Jul 02 17:15:48.537852 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:48.537808    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2" event={"ID":"d93eabfc-f5b1-4b09-a924-f8f22e648816","Type":"ContainerStarted","Data":"14d4a66883d0809b90f9f050ac47e7197b710ee6da92812ec4f8dded9acfff99"}
Jul 02 17:15:48.615493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:48.615456    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"]
Jul 02 17:15:48.618874 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:15:48.618844    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d008f36_b1b6_42fc_8792_083acd49db0d.slice/crio-9e8ec503f0af70d9b0d39a397a9f7d9ff8385c02caac5746c55f342188de8465 WatchSource:0}: Error finding container 9e8ec503f0af70d9b0d39a397a9f7d9ff8385c02caac5746c55f342188de8465: Status 404 returned error can't find the container with id 9e8ec503f0af70d9b0d39a397a9f7d9ff8385c02caac5746c55f342188de8465
Jul 02 17:15:49.047123 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.047086    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 17:15:49.049784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.049757    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.063862 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.063831    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 17:15:49.064067 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.063955    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 17:15:49.064067 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.063955    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 17:15:49.064273 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.064223    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 17:15:49.064273 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.064233    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 17:15:49.064550 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.064487    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 17:15:49.064550 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.064506    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 17:15:49.064726 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.064554    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 17:15:49.064726 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.064668    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 17:15:49.064726 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.064705    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jn2v2\""
Jul 02 17:15:49.064911 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.064893    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 17:15:49.065531 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.065506    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a83ig7rtcad6t\""
Jul 02 17:15:49.066800 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.066782    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 17:15:49.066800 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.066800    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 17:15:49.072380 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.072340    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 17:15:49.080491 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.080462    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 17:15:49.085826 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.085803    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 17:15:49.098024 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.097968    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098054    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098074    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098103    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098128    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7v8\" (UniqueName: \"kubernetes.io/projected/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-kube-api-access-rq7v8\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098151    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098248    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098289    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098331    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098368    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098400    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098666 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098428    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098666 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098452    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098666 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098478    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098666 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098504    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098666 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098526    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098666 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098554    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098666 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098578    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098956 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098707    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-config\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.098956 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.098746    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.112861 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.112822    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 17:15:49.199771 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199733    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.199771 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199767    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.199999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199794    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.199999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199811    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7v8\" (UniqueName: \"kubernetes.io/projected/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-kube-api-access-rq7v8\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.199999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199828    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.199999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199850    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.199999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199879    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.199999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199903    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.199999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.199987    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200015    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200040    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200064    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200087    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200114    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200137    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200167    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200191    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200271    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-config\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200309    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200340    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200919 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200855    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.200919 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200871    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.201019 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200936    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.201019 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.200960    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.201872 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.201543    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.201872 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.201580    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.205256 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.204741    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-web-config\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.205256 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.204783    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.205256 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.205175    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.205668 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.205586    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-config\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.206727 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.205871    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.206727 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.206251    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-config-out\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.206727 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.206297    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.206727 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.206497    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.206727 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.206541    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.207030 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.206980    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.210959 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.209355    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.211061 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.211029    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.213086 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.213059    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.214366 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.214345    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7v8\" (UniqueName: \"kubernetes.io/projected/5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0-kube-api-access-rq7v8\") pod \"prometheus-k8s-0\" (UID: \"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.361046 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.360955    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:15:49.533999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.533891    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 17:15:49.539816 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:15:49.539779    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5f1fe1_b82c_44a9_a4c5_97997b4c5ca0.slice/crio-74545c78789ae71c9e31a1c22fc619f9c16f9f187e498e8018aadfa7219e1476 WatchSource:0}: Error finding container 74545c78789ae71c9e31a1c22fc619f9c16f9f187e498e8018aadfa7219e1476: Status 404 returned error can't find the container with id 74545c78789ae71c9e31a1c22fc619f9c16f9f187e498e8018aadfa7219e1476
Jul 02 17:15:49.545135 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.545100    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl" event={"ID":"1d008f36-b1b6-42fc-8792-083acd49db0d","Type":"ContainerStarted","Data":"9e8ec503f0af70d9b0d39a397a9f7d9ff8385c02caac5746c55f342188de8465"}
Jul 02 17:15:49.549273 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.549241    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2" event={"ID":"d93eabfc-f5b1-4b09-a924-f8f22e648816","Type":"ContainerStarted","Data":"99cadcf8dc619d6319475a54313cb8993fbbf3d9a8dbbc9e3c53cb50e59603ea"}
Jul 02 17:15:49.874490 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.874447    2550 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" podUID="cdb9e57b-9a91-423f-a6cd-4bb8af060827" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 02 17:15:49.874915 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.874528    2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z"
Jul 02 17:15:49.875143 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.875110    2550 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"698a6c4d124f966b9c2e66928b29f7a87deaa4741f44415b3946d7158818c048"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 02 17:15:49.875188 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:49.875166    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" podUID="cdb9e57b-9a91-423f-a6cd-4bb8af060827" containerName="service-proxy" containerID="cri-o://698a6c4d124f966b9c2e66928b29f7a87deaa4741f44415b3946d7158818c048" gracePeriod=30
Jul 02 17:15:50.557390 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.557292    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2" event={"ID":"d93eabfc-f5b1-4b09-a924-f8f22e648816","Type":"ContainerStarted","Data":"78ac8256b1b11691b1c50395094d27d84b617a3d27790bf6201b68c078d951fa"}
Jul 02 17:15:50.557390 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.557381    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2" event={"ID":"d93eabfc-f5b1-4b09-a924-f8f22e648816","Type":"ContainerStarted","Data":"81ccd07e95f722c7bb0e719052db9f37955fdfbf29d02196c5169839ca8adfae"}
Jul 02 17:15:50.557668 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.557433    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:50.558838 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.558812    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0","Type":"ContainerStarted","Data":"74545c78789ae71c9e31a1c22fc619f9c16f9f187e498e8018aadfa7219e1476"}
Jul 02 17:15:50.561454 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.561423    2550 generic.go:356] "Generic (PLEG): container finished" podID="cdb9e57b-9a91-423f-a6cd-4bb8af060827" containerID="698a6c4d124f966b9c2e66928b29f7a87deaa4741f44415b3946d7158818c048" exitCode=2
Jul 02 17:15:50.561555 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.561491    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" event={"ID":"cdb9e57b-9a91-423f-a6cd-4bb8af060827","Type":"ContainerDied","Data":"698a6c4d124f966b9c2e66928b29f7a87deaa4741f44415b3946d7158818c048"}
Jul 02 17:15:50.561555 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.561541    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fc8f864f-l949z" event={"ID":"cdb9e57b-9a91-423f-a6cd-4bb8af060827","Type":"ContainerStarted","Data":"842ba2d081442648c4f47b154848c15e660c7db6bd632c50e333bb4756de84c7"}
Jul 02 17:15:50.563136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.563114    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl" event={"ID":"1d008f36-b1b6-42fc-8792-083acd49db0d","Type":"ContainerStarted","Data":"7943d1476f7ce1a4beb6b23dba6110f016efcb7134e391569fd8d67e8d137eba"}
Jul 02 17:15:50.563382 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.563364    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:50.569799 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.569781    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl"
Jul 02 17:15:50.580195 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.580145    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2" podStartSLOduration=2.664012557 podStartE2EDuration="6.580127278s" totalImagesPullingTime="3.916114721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:50.578430625 +0000 UTC m=+305.569390900" watchObservedRunningTime="2026-07-02 17:15:50.580127278 +0000 UTC m=+305.571087534"
Jul 02 17:15:50.595120 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:50.595075    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-45pgl" podStartSLOduration=2.029341473 podStartE2EDuration="3.595056444s" totalImagesPullingTime="1.565714971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:50.594733344 +0000 UTC m=+305.585693613" watchObservedRunningTime="2026-07-02 17:15:50.595056444 +0000 UTC m=+305.586016699"
Jul 02 17:15:51.568727 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:51.568679    2550 generic.go:356] "Generic (PLEG): container finished" podID="5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0" containerID="f9d41e907b9229b0ae44d7baeefe6278a4e866177078927777359219d835b679" exitCode=0
Jul 02 17:15:51.569202 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:51.568785    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0","Type":"ContainerDied","Data":"f9d41e907b9229b0ae44d7baeefe6278a4e866177078927777359219d835b679"}
Jul 02 17:15:53.449133 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:53.449093    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:15:55.588095 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:55.588009    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0","Type":"ContainerStarted","Data":"b3aafb8361c5d63ababfa469c3728bbc53c04b64139c44ff10928a013fc52ce9"}
Jul 02 17:15:55.588095 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:55.588074    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0","Type":"ContainerStarted","Data":"de7478753ea53ce51ba7822a15b2a33b5aaa3700f4c080cc3e725e5cb1eb9d0f"}
Jul 02 17:15:55.588467 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:55.588103    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0","Type":"ContainerStarted","Data":"0be82f08d80e4dac08939d0a5376d1fc401407fbde91314c9ab32eb078d6039f"}
Jul 02 17:15:55.588467 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:55.588132    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0","Type":"ContainerStarted","Data":"f6943e016e5b7d6267516e3f39cc2ed30ef34b2a175c1cd6dc96a281b0c79c23"}
Jul 02 17:15:55.588467 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:55.588164    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0","Type":"ContainerStarted","Data":"6df2d8f393be3983ecd34fed03dffdde8774a9cc911d4d5315df92ac798ca3db"}
Jul 02 17:15:55.588467 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:55.588188    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0","Type":"ContainerStarted","Data":"cfacbe65b23235f540cbbc25d8f341fbc5a150dc66df3f60771b889248799b9b"}
Jul 02 17:15:55.617489 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:55.617432    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.80782511 podStartE2EDuration="6.617414907s" totalImagesPullingTime="4.786140394s" totalInitContainerRuntime="23.449403ms" isStatefulPod=false podCreationTimestamp="2026-07-02 17:15:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:15:55.616239156 +0000 UTC m=+310.607199426" watchObservedRunningTime="2026-07-02 17:15:55.617414907 +0000 UTC m=+310.608375161"
Jul 02 17:15:56.576261 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:56.576230    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74c894c97d-g6wg2"
Jul 02 17:15:59.362112 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:15:59.362073    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:16:07.255752 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.255713    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55984c446d-wn4rb" podUID="a0bb736e-cdc6-4904-b9a3-e23281a3a148" containerName="console" containerID="cri-o://d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534" gracePeriod=15
Jul 02 17:16:07.496793 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.496770    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:16:07.639232 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.639204    2550 generic.go:356] "Generic (PLEG): container finished" podID="a0bb736e-cdc6-4904-b9a3-e23281a3a148" containerID="d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534" exitCode=0
Jul 02 17:16:07.639405 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.639245    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55984c446d-wn4rb" event={"ID":"a0bb736e-cdc6-4904-b9a3-e23281a3a148","Type":"ContainerDied","Data":"d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534"}
Jul 02 17:16:07.639405 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.639250    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55984c446d-wn4rb"
Jul 02 17:16:07.639405 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.639282    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55984c446d-wn4rb" event={"ID":"a0bb736e-cdc6-4904-b9a3-e23281a3a148","Type":"ContainerDied","Data":"873f9a05e87b21c1fa2c71cf29c222178abffffea446c3dfa9ede3ee119e74d4"}
Jul 02 17:16:07.639405 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.639315    2550 scope.go:117] "RemoveContainer" containerID="d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534"
Jul 02 17:16:07.648065 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.648037    2550 scope.go:117] "RemoveContainer" containerID="d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534"
Jul 02 17:16:07.648360 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:16:07.648339    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534\": container with ID starting with d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534 not found: ID does not exist" containerID="d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534"
Jul 02 17:16:07.648429 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.648369    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534"} err="failed to get container status \"d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534\": rpc error: code = NotFound desc = could not find container \"d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534\": container with ID starting with d2e92e900b09ca352466e6a81c1986ee6f504ebeea9194651949f7dbe1517534 not found: ID does not exist"
Jul 02 17:16:07.671692 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.671660    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-serving-cert\") pod \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") "
Jul 02 17:16:07.671807 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.671700    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-service-ca\") pod \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") "
Jul 02 17:16:07.671807 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.671759    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-oauth-config\") pod \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") "
Jul 02 17:16:07.671807 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.671788    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-oauth-serving-cert\") pod \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") "
Jul 02 17:16:07.671807 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.671804    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqfqq\" (UniqueName: \"kubernetes.io/projected/a0bb736e-cdc6-4904-b9a3-e23281a3a148-kube-api-access-jqfqq\") pod \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") "
Jul 02 17:16:07.672004 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.671890    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-config\") pod \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\" (UID: \"a0bb736e-cdc6-4904-b9a3-e23281a3a148\") "
Jul 02 17:16:07.672189 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.672162    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-service-ca" (OuterVolumeSpecName: "service-ca") pod "a0bb736e-cdc6-4904-b9a3-e23281a3a148" (UID: "a0bb736e-cdc6-4904-b9a3-e23281a3a148"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:16:07.672284 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.672225    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a0bb736e-cdc6-4904-b9a3-e23281a3a148" (UID: "a0bb736e-cdc6-4904-b9a3-e23281a3a148"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:16:07.672284 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.672255    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-config" (OuterVolumeSpecName: "console-config") pod "a0bb736e-cdc6-4904-b9a3-e23281a3a148" (UID: "a0bb736e-cdc6-4904-b9a3-e23281a3a148"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:16:07.673896 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.673875    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a0bb736e-cdc6-4904-b9a3-e23281a3a148" (UID: "a0bb736e-cdc6-4904-b9a3-e23281a3a148"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:16:07.674050 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.674025    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0bb736e-cdc6-4904-b9a3-e23281a3a148-kube-api-access-jqfqq" (OuterVolumeSpecName: "kube-api-access-jqfqq") pod "a0bb736e-cdc6-4904-b9a3-e23281a3a148" (UID: "a0bb736e-cdc6-4904-b9a3-e23281a3a148"). InnerVolumeSpecName "kube-api-access-jqfqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:16:07.674098 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.674061    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a0bb736e-cdc6-4904-b9a3-e23281a3a148" (UID: "a0bb736e-cdc6-4904-b9a3-e23281a3a148"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:16:07.772964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.772932    2550 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-oauth-serving-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:16:07.772964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.772958    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqfqq\" (UniqueName: \"kubernetes.io/projected/a0bb736e-cdc6-4904-b9a3-e23281a3a148-kube-api-access-jqfqq\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:16:07.772964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.772969    2550 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-config\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:16:07.773198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.772978    2550 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-serving-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:16:07.773198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.772987    2550 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0bb736e-cdc6-4904-b9a3-e23281a3a148-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:16:07.773198 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.772995    2550 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0bb736e-cdc6-4904-b9a3-e23281a3a148-console-oauth-config\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:16:07.960684 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.960646    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55984c446d-wn4rb"]
Jul 02 17:16:07.964585 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:07.964552    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55984c446d-wn4rb"]
Jul 02 17:16:09.457404 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:09.457362    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0bb736e-cdc6-4904-b9a3-e23281a3a148" path="/var/lib/kubelet/pods/a0bb736e-cdc6-4904-b9a3-e23281a3a148/volumes"
Jul 02 17:16:49.361826 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:49.361776    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:16:49.382428 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:49.382399    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:16:49.809933 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:49.809900    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 17:16:58.310981 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:58.310932    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:16:58.313294 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:58.313270    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19f0cb34-ac3a-4521-bc54-c453c6db705c-metrics-certs\") pod \"network-metrics-daemon-8npvm\" (UID: \"19f0cb34-ac3a-4521-bc54-c453c6db705c\") " pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:16:58.552464 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:58.552435    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vg44r\""
Jul 02 17:16:58.561247 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:58.561169    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8npvm"
Jul 02 17:16:58.685848 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:58.685820    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8npvm"]
Jul 02 17:16:58.688618 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:16:58.688566    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f0cb34_ac3a_4521_bc54_c453c6db705c.slice/crio-b4ac948d536854c71e0dcc681c7f7287ba093bb23a69659917cf4959d550d491 WatchSource:0}: Error finding container b4ac948d536854c71e0dcc681c7f7287ba093bb23a69659917cf4959d550d491: Status 404 returned error can't find the container with id b4ac948d536854c71e0dcc681c7f7287ba093bb23a69659917cf4959d550d491
Jul 02 17:16:58.827910 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:58.827811    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8npvm" event={"ID":"19f0cb34-ac3a-4521-bc54-c453c6db705c","Type":"ContainerStarted","Data":"b4ac948d536854c71e0dcc681c7f7287ba093bb23a69659917cf4959d550d491"}
Jul 02 17:16:59.833869 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:59.833775    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8npvm" event={"ID":"19f0cb34-ac3a-4521-bc54-c453c6db705c","Type":"ContainerStarted","Data":"8f13b56343299b5148dd3838a11826f2e12f0727f9a7998b7ce6940f869e1aef"}
Jul 02 17:16:59.833869 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:59.833825    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8npvm" event={"ID":"19f0cb34-ac3a-4521-bc54-c453c6db705c","Type":"ContainerStarted","Data":"1d55f29f025e9347f5848ff4943b2a05073ed90bb6bee14f5e6024e5c38465c8"}
Jul 02 17:16:59.848477 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:16:59.848428    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8npvm" podStartSLOduration=373.993039439 podStartE2EDuration="6m14.848413042s" totalImagesPullingTime="855.373603ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:16:59.847195366 +0000 UTC m=+374.838155622" watchObservedRunningTime="2026-07-02 17:16:59.848413042 +0000 UTC m=+374.839373296"
Jul 02 17:19:03.531151 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.531118    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"]
Jul 02 17:19:03.531751 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.531535    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0bb736e-cdc6-4904-b9a3-e23281a3a148" containerName="console"
Jul 02 17:19:03.531751 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.531556    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0bb736e-cdc6-4904-b9a3-e23281a3a148" containerName="console"
Jul 02 17:19:03.531751 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.531645    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0bb736e-cdc6-4904-b9a3-e23281a3a148" containerName="console"
Jul 02 17:19:03.533551 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.533531    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.536731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.536706    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 17:19:03.536843 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.536763    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 17:19:03.536843 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.536798    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 17:19:03.537564 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.537540    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 17:19:03.537631 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.537555    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rf7js\""
Jul 02 17:19:03.556392 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.556360    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"]
Jul 02 17:19:03.624932 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.624895    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed8df491-0627-497f-a42f-2574a394bd0a-manifests\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.625107 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.624975    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed8df491-0627-497f-a42f-2574a394bd0a-tmp\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.625107 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.624998    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbslk\" (UniqueName: \"kubernetes.io/projected/ed8df491-0627-497f-a42f-2574a394bd0a-kube-api-access-kbslk\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.625107 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.625025    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed8df491-0627-497f-a42f-2574a394bd0a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.625107 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.625071    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed8df491-0627-497f-a42f-2574a394bd0a-webhook-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.726410 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.726371    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed8df491-0627-497f-a42f-2574a394bd0a-tmp\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.726629 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.726415    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbslk\" (UniqueName: \"kubernetes.io/projected/ed8df491-0627-497f-a42f-2574a394bd0a-kube-api-access-kbslk\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.726629 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.726449    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed8df491-0627-497f-a42f-2574a394bd0a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.726629 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.726474    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed8df491-0627-497f-a42f-2574a394bd0a-webhook-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.726629 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.726500    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed8df491-0627-497f-a42f-2574a394bd0a-manifests\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.726929 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.726900    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed8df491-0627-497f-a42f-2574a394bd0a-manifests\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.728749 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.728719    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed8df491-0627-497f-a42f-2574a394bd0a-tmp\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.728995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.728975    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed8df491-0627-497f-a42f-2574a394bd0a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.729066 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.729021    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed8df491-0627-497f-a42f-2574a394bd0a-webhook-cert\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.735202 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.735169    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbslk\" (UniqueName: \"kubernetes.io/projected/ed8df491-0627-497f-a42f-2574a394bd0a-kube-api-access-kbslk\") pod \"opendatahub-operator-controller-manager-546844fdf5-rqptz\" (UID: \"ed8df491-0627-497f-a42f-2574a394bd0a\") " pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.843722 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.843627    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:03.986493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:03.986455    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"]
Jul 02 17:19:03.990794 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:19:03.990768    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8df491_0627_497f_a42f_2574a394bd0a.slice/crio-c21e3857b4533eb625602f210290cf1016355c0649728346b1dba61ddbc43d92 WatchSource:0}: Error finding container c21e3857b4533eb625602f210290cf1016355c0649728346b1dba61ddbc43d92: Status 404 returned error can't find the container with id c21e3857b4533eb625602f210290cf1016355c0649728346b1dba61ddbc43d92
Jul 02 17:19:04.297205 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:04.297166    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz" event={"ID":"ed8df491-0627-497f-a42f-2574a394bd0a","Type":"ContainerStarted","Data":"c21e3857b4533eb625602f210290cf1016355c0649728346b1dba61ddbc43d92"}
Jul 02 17:19:07.312820 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:07.312789    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz" event={"ID":"ed8df491-0627-497f-a42f-2574a394bd0a","Type":"ContainerStarted","Data":"f3a79fbf876b55fc201f65ca6898bb2c04cfe5d91967e3c5ff648f1c02c146b8"}
Jul 02 17:19:08.317955 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:08.317923    2550 generic.go:356] "Generic (PLEG): container finished" podID="ed8df491-0627-497f-a42f-2574a394bd0a" containerID="f3a79fbf876b55fc201f65ca6898bb2c04cfe5d91967e3c5ff648f1c02c146b8" exitCode=0
Jul 02 17:19:08.318402 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:08.317973    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz" event={"ID":"ed8df491-0627-497f-a42f-2574a394bd0a","Type":"ContainerDied","Data":"f3a79fbf876b55fc201f65ca6898bb2c04cfe5d91967e3c5ff648f1c02c146b8"}
Jul 02 17:19:09.323349 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:09.323320    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz" event={"ID":"ed8df491-0627-497f-a42f-2574a394bd0a","Type":"ContainerStarted","Data":"bf5a6a6c59a283e83745593dce2328c00973eb791215d0d098accc5d9f535daa"}
Jul 02 17:19:09.323751 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:09.323426    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:09.342402 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:09.342349    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz" podStartSLOduration=1.707961702 podStartE2EDuration="6.342330365s" totalImagesPullingTime="3.54407532s" totalInitContainerRuntime="1.090293343s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:09.341349036 +0000 UTC m=+504.332309291" watchObservedRunningTime="2026-07-02 17:19:09.342330365 +0000 UTC m=+504.333290622"
Jul 02 17:19:20.329525 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:20.329495    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-546844fdf5-rqptz"
Jul 02 17:19:23.787243 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.787210    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"]
Jul 02 17:19:23.796376 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.796345    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.798459 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.798418    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-55p5f\""
Jul 02 17:19:23.798618 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.798557    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 17:19:23.799035 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.799008    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 17:19:23.799311 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.799289    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 17:19:23.799423 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.799297    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 17:19:23.799423 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.799378    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 17:19:23.803920 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.803898    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"]
Jul 02 17:19:23.891934 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.891893    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-manager-config\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.891934 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.891936    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-cert\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.892182 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.891963    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-metrics-cert\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.892182 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.891980    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fldbj\" (UniqueName: \"kubernetes.io/projected/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-kube-api-access-fldbj\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.993358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.993323    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-manager-config\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.993358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.993361    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-cert\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.993549 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.993398    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-metrics-cert\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.993549 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.993513    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fldbj\" (UniqueName: \"kubernetes.io/projected/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-kube-api-access-fldbj\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.994105 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.994084    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-manager-config\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.995981 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.995951    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-cert\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:23.996086 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:23.996034    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-metrics-cert\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:24.005183 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.005157    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fldbj\" (UniqueName: \"kubernetes.io/projected/1294eb97-1c43-4a2c-9a98-5d56fb55ee5c-kube-api-access-fldbj\") pod \"lws-controller-manager-7f779dbb76-bgwfr\" (UID: \"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c\") " pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:24.089096 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.089007    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sjxrr"]
Jul 02 17:19:24.091056 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.091039    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:24.093971 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.093948    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 02 17:19:24.094088 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.093988    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-44vf7\""
Jul 02 17:19:24.103640 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.103616    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sjxrr"]
Jul 02 17:19:24.108003 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.107985    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:24.194554 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.194522    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn78w\" (UniqueName: \"kubernetes.io/projected/4e867551-a8e2-491b-bf59-a85af1c5112d-kube-api-access-mn78w\") pod \"model-serving-api-54d89bd5fc-sjxrr\" (UID: \"4e867551-a8e2-491b-bf59-a85af1c5112d\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:24.194712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.194568    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e867551-a8e2-491b-bf59-a85af1c5112d-tls-certs\") pod \"model-serving-api-54d89bd5fc-sjxrr\" (UID: \"4e867551-a8e2-491b-bf59-a85af1c5112d\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:24.231727 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.231694    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"]
Jul 02 17:19:24.235408 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:19:24.235383    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1294eb97_1c43_4a2c_9a98_5d56fb55ee5c.slice/crio-acee19c056c9f1b6695507fade8feff3f6104213b77224a1c769ef5ba6d72038 WatchSource:0}: Error finding container acee19c056c9f1b6695507fade8feff3f6104213b77224a1c769ef5ba6d72038: Status 404 returned error can't find the container with id acee19c056c9f1b6695507fade8feff3f6104213b77224a1c769ef5ba6d72038
Jul 02 17:19:24.295937 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.295899    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn78w\" (UniqueName: \"kubernetes.io/projected/4e867551-a8e2-491b-bf59-a85af1c5112d-kube-api-access-mn78w\") pod \"model-serving-api-54d89bd5fc-sjxrr\" (UID: \"4e867551-a8e2-491b-bf59-a85af1c5112d\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:24.296095 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.295943    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e867551-a8e2-491b-bf59-a85af1c5112d-tls-certs\") pod \"model-serving-api-54d89bd5fc-sjxrr\" (UID: \"4e867551-a8e2-491b-bf59-a85af1c5112d\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:24.298268 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.298240    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e867551-a8e2-491b-bf59-a85af1c5112d-tls-certs\") pod \"model-serving-api-54d89bd5fc-sjxrr\" (UID: \"4e867551-a8e2-491b-bf59-a85af1c5112d\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:24.303499 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.303472    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn78w\" (UniqueName: \"kubernetes.io/projected/4e867551-a8e2-491b-bf59-a85af1c5112d-kube-api-access-mn78w\") pod \"model-serving-api-54d89bd5fc-sjxrr\" (UID: \"4e867551-a8e2-491b-bf59-a85af1c5112d\") " pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:24.379723 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.379694    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr" event={"ID":"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c","Type":"ContainerStarted","Data":"acee19c056c9f1b6695507fade8feff3f6104213b77224a1c769ef5ba6d72038"}
Jul 02 17:19:24.401261 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.401223    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:24.535448 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:24.535331    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-sjxrr"]
Jul 02 17:19:24.537979 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:19:24.537949    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e867551_a8e2_491b_bf59_a85af1c5112d.slice/crio-2229cc443dedb2ff5ea5b515bfa1f5803351915796ca6492f24510eb35000bc0 WatchSource:0}: Error finding container 2229cc443dedb2ff5ea5b515bfa1f5803351915796ca6492f24510eb35000bc0: Status 404 returned error can't find the container with id 2229cc443dedb2ff5ea5b515bfa1f5803351915796ca6492f24510eb35000bc0
Jul 02 17:19:25.386781 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:25.386709    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr" event={"ID":"4e867551-a8e2-491b-bf59-a85af1c5112d","Type":"ContainerStarted","Data":"2229cc443dedb2ff5ea5b515bfa1f5803351915796ca6492f24510eb35000bc0"}
Jul 02 17:19:27.396041 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:27.396006    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr" event={"ID":"4e867551-a8e2-491b-bf59-a85af1c5112d","Type":"ContainerStarted","Data":"99d5778c666826df9fd6395ea42ba68b4cd8d7f4adb792f65c48a928862e86a2"}
Jul 02 17:19:27.396444 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:27.396087    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:19:27.397539 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:27.397515    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr" event={"ID":"1294eb97-1c43-4a2c-9a98-5d56fb55ee5c","Type":"ContainerStarted","Data":"64c45bd14e7275cbb0e6016beac0d1969840b6ca45be6cd78e271e4a50e484e9"}
Jul 02 17:19:27.397648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:27.397561    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:27.412476 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:27.412430    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr" podStartSLOduration=0.757026581 podStartE2EDuration="3.412414566s" totalImagesPullingTime="2.655387985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:27.411434265 +0000 UTC m=+522.402394522" watchObservedRunningTime="2026-07-02 17:19:27.412414566 +0000 UTC m=+522.403374820"
Jul 02 17:19:27.425798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:27.425745    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr" podStartSLOduration=1.466501804 podStartE2EDuration="4.425726097s" totalImagesPullingTime="2.959224293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:27.425433535 +0000 UTC m=+522.416393791" watchObservedRunningTime="2026-07-02 17:19:27.425726097 +0000 UTC m=+522.416686352"
Jul 02 17:19:29.082326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.082290    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"]
Jul 02 17:19:29.086178 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.086146    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.088990 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.088964    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 17:19:29.089106 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.089027    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6jsnm\""
Jul 02 17:19:29.089106 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.089072    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 17:19:29.089358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.089345    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 17:19:29.099057 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.099035    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"]
Jul 02 17:19:29.138712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.138676    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.138712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.138712    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.139021 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.138750    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7e3fcc4-411b-40fa-871a-9f31e47735db-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.139021 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.138823    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.139021 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.138861    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdcm9\" (UniqueName: \"kubernetes.io/projected/a7e3fcc4-411b-40fa-871a-9f31e47735db-kube-api-access-kdcm9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.139021 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.138895    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.139021 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.138964    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.139021 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.138991    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.139021 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.139016    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.239997 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.239961    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.239997 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.239996    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240043    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7e3fcc4-411b-40fa-871a-9f31e47735db-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240062    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240081    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdcm9\" (UniqueName: \"kubernetes.io/projected/a7e3fcc4-411b-40fa-871a-9f31e47735db-kube-api-access-kdcm9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240101    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240153    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240179    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240258 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240211    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240613 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240422    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240674 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240582    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240674 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240627    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240775 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240680    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.240931 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.240912    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7e3fcc4-411b-40fa-871a-9f31e47735db-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.242318 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.242296    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.242684 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.242669    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.247284 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.247266    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7e3fcc4-411b-40fa-871a-9f31e47735db-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.247350 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.247325    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdcm9\" (UniqueName: \"kubernetes.io/projected/a7e3fcc4-411b-40fa-871a-9f31e47735db-kube-api-access-kdcm9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mhft4\" (UID: \"a7e3fcc4-411b-40fa-871a-9f31e47735db\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.395787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.395751    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:29.527821 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:29.527787    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"]
Jul 02 17:19:29.531294 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:19:29.531258    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e3fcc4_411b_40fa_871a_9f31e47735db.slice/crio-f3dc672dc0f8860e9302a759ad3e7080c9df744743b195f5265ae4bd1b656638 WatchSource:0}: Error finding container f3dc672dc0f8860e9302a759ad3e7080c9df744743b195f5265ae4bd1b656638: Status 404 returned error can't find the container with id f3dc672dc0f8860e9302a759ad3e7080c9df744743b195f5265ae4bd1b656638
Jul 02 17:19:30.412331 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:30.412299    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4" event={"ID":"a7e3fcc4-411b-40fa-871a-9f31e47735db","Type":"ContainerStarted","Data":"f3dc672dc0f8860e9302a759ad3e7080c9df744743b195f5265ae4bd1b656638"}
Jul 02 17:19:32.129359 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.129283    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"]
Jul 02 17:19:32.132785 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.132763    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.135102 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.135078    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 17:19:32.135833 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.135808    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 17:19:32.135951 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.135851    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-md5cm\""
Jul 02 17:19:32.138716 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.138698    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 17:19:32.168818 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.168786    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af35f710-1037-4ae3-b0ed-ccac8ee798ce-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.168985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.168844    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bddcj\" (UniqueName: \"kubernetes.io/projected/af35f710-1037-4ae3-b0ed-ccac8ee798ce-kube-api-access-bddcj\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.168985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.168908    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.168985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.168930    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.168985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.168956    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.168985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.168983    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.169206 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.169021    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.171587 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.171563    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"]
Jul 02 17:19:32.270375 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.270330    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.270375 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.270373    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.270658 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.270402    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.270658 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.270436    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.270658 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.270467    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.270658 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.270540    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af35f710-1037-4ae3-b0ed-ccac8ee798ce-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.270658 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.270585    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bddcj\" (UniqueName: \"kubernetes.io/projected/af35f710-1037-4ae3-b0ed-ccac8ee798ce-kube-api-access-bddcj\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.271264 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.271210    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.273390 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.273342    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af35f710-1037-4ae3-b0ed-ccac8ee798ce-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.273512 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.273409    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.273583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.273518    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.273722 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.273701    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af35f710-1037-4ae3-b0ed-ccac8ee798ce-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.286535 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.286511    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bddcj\" (UniqueName: \"kubernetes.io/projected/af35f710-1037-4ae3-b0ed-ccac8ee798ce-kube-api-access-bddcj\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.290152 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.290127    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af35f710-1037-4ae3-b0ed-ccac8ee798ce-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sz2dh\" (UID: \"af35f710-1037-4ae3-b0ed-ccac8ee798ce\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.444236 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.444158    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:32.609171 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:32.609137    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"]
Jul 02 17:19:32.611996 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:19:32.611969    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf35f710_1037_4ae3_b0ed_ccac8ee798ce.slice/crio-dc0967fc3279cdfa92d9ac634a9220e4874e42b3385ca8eebde25a09182ad144 WatchSource:0}: Error finding container dc0967fc3279cdfa92d9ac634a9220e4874e42b3385ca8eebde25a09182ad144: Status 404 returned error can't find the container with id dc0967fc3279cdfa92d9ac634a9220e4874e42b3385ca8eebde25a09182ad144
Jul 02 17:19:33.427247 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:33.427207    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh" event={"ID":"af35f710-1037-4ae3-b0ed-ccac8ee798ce","Type":"ContainerStarted","Data":"dc0967fc3279cdfa92d9ac634a9220e4874e42b3385ca8eebde25a09182ad144"}
Jul 02 17:19:36.218809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.218768    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:19:36.219054 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.218844    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:19:36.222264 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.222238    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:19:36.222337 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.222300    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:19:36.222337 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.222328    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:19:36.443547 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.443458    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh" event={"ID":"af35f710-1037-4ae3-b0ed-ccac8ee798ce","Type":"ContainerStarted","Data":"0f27f493f5f2a8d8892f1cf66ed2254d3c24ea5c72bd9f9eb7af262a49b1cb97"}
Jul 02 17:19:36.443547 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.443525    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:36.445203 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.445179    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4" event={"ID":"a7e3fcc4-411b-40fa-871a-9f31e47735db","Type":"ContainerStarted","Data":"db270dde0d87dc98ed8efa304a5c2e0ee98c08b9a5d4dea931cde951c4043652"}
Jul 02 17:19:36.465795 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.465725    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh" podStartSLOduration=0.861294415 podStartE2EDuration="4.465711208s" totalImagesPullingTime="3.604416793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:36.464731364 +0000 UTC m=+531.455691651" watchObservedRunningTime="2026-07-02 17:19:36.465711208 +0000 UTC m=+531.456671462"
Jul 02 17:19:36.484055 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:36.483947    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4" podStartSLOduration=0.795347739 podStartE2EDuration="7.483926767s" totalImagesPullingTime="6.688579028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:19:36.481355924 +0000 UTC m=+531.472316180" watchObservedRunningTime="2026-07-02 17:19:36.483926767 +0000 UTC m=+531.474887022"
Jul 02 17:19:37.396870 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:37.396837    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:37.401565 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:37.401534    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:37.454130 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:37.453920    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:37.454130 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:37.454011    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mhft4"
Jul 02 17:19:37.454130 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:37.454061    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sz2dh"
Jul 02 17:19:38.403992 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:38.403961    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f779dbb76-bgwfr"
Jul 02 17:19:38.405700 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:19:38.405681    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-sjxrr"
Jul 02 17:20:45.436067 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:20:45.436033    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:20:45.436664 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:20:45.436320    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:21:52.591285 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.591245    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"]
Jul 02 17:21:52.593788 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.593767    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.595751 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.595728    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hdm74\""
Jul 02 17:21:52.610871 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.610842    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"]
Jul 02 17:21:52.685245 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685201    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.685431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685252    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.685431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685290    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.685431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685318    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.685431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685349    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.685431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685383    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.685431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685417    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.685781 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685509    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbv7q\" (UniqueName: \"kubernetes.io/projected/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-kube-api-access-rbv7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.685781 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.685553    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786186 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786145    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbv7q\" (UniqueName: \"kubernetes.io/projected/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-kube-api-access-rbv7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786384 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786200    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786384 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786242    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786384 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786260    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786384 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786289    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786384 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786318    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786384 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786344    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786384 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786374    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786783 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786407    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786848 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786820    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786902 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786847    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786938 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786904    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.786972 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.786960    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.787177 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.787157    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.789148 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.789117    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.789480 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.789457    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.794068 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.794042    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbv7q\" (UniqueName: \"kubernetes.io/projected/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-kube-api-access-rbv7q\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.794175 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.794063    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pmht6\" (UID: \"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:52.903842 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:52.903794    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:53.033426 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:53.033392    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"]
Jul 02 17:21:53.037293 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:21:53.037262    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa935ca9_c4c1_48d1_bcd7_f6e8d186c70a.slice/crio-349fe3b836507cf3cb0447c1f091f75e6f61f04a6fc761520295550a7b30fe84 WatchSource:0}: Error finding container 349fe3b836507cf3cb0447c1f091f75e6f61f04a6fc761520295550a7b30fe84: Status 404 returned error can't find the container with id 349fe3b836507cf3cb0447c1f091f75e6f61f04a6fc761520295550a7b30fe84
Jul 02 17:21:53.039316 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:53.039281    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:21:53.039410 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:53.039365    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:21:53.039471 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:53.039410    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:21:54.012338 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:54.012305    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" event={"ID":"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a","Type":"ContainerStarted","Data":"08e76a574dec7f7bb1f7b50028e4820df10ffe7d43348e196a170c8ee67b054a"}
Jul 02 17:21:54.012756 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:54.012355    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" event={"ID":"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a","Type":"ContainerStarted","Data":"349fe3b836507cf3cb0447c1f091f75e6f61f04a6fc761520295550a7b30fe84"}
Jul 02 17:21:54.031668 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:54.031564    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" podStartSLOduration=2.031540593 podStartE2EDuration="2.031540593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:21:54.031100769 +0000 UTC m=+669.022061040" watchObservedRunningTime="2026-07-02 17:21:54.031540593 +0000 UTC m=+669.022500847"
Jul 02 17:21:54.904933 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:54.904891    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:54.909499 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:54.909467    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:55.017019 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:55.016993    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:21:55.018137 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:21:55.018114    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:23:45.121129 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.121094    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54965dc45b-t2gfb"]
Jul 02 17:23:45.124640 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.124616    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:45.129543 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.129501    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 17:23:45.129698 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.129552    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zshh\""
Jul 02 17:23:45.129698 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.129646    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 17:23:45.137336 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.137308    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54965dc45b-t2gfb"]
Jul 02 17:23:45.268625 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.268553    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-webhook-cert\") pod \"maas-controller-54965dc45b-t2gfb\" (UID: \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\") " pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:45.268814 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.268676    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn9hg\" (UniqueName: \"kubernetes.io/projected/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-kube-api-access-vn9hg\") pod \"maas-controller-54965dc45b-t2gfb\" (UID: \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\") " pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:45.305168 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.305134    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-tk2sp"]
Jul 02 17:23:45.308345 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.308322    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:45.318097 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.318070    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-tk2sp"]
Jul 02 17:23:45.369252 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.369210    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-webhook-cert\") pod \"maas-controller-85f9dc7b46-tk2sp\" (UID: \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\") " pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:45.369252 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.369255    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlqns\" (UniqueName: \"kubernetes.io/projected/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-kube-api-access-zlqns\") pod \"maas-controller-85f9dc7b46-tk2sp\" (UID: \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\") " pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:45.369530 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.369289    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn9hg\" (UniqueName: \"kubernetes.io/projected/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-kube-api-access-vn9hg\") pod \"maas-controller-54965dc45b-t2gfb\" (UID: \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\") " pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:45.369530 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.369385    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-webhook-cert\") pod \"maas-controller-54965dc45b-t2gfb\" (UID: \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\") " pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:45.372200 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.372140    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-webhook-cert\") pod \"maas-controller-54965dc45b-t2gfb\" (UID: \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\") " pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:45.376635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.376609    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn9hg\" (UniqueName: \"kubernetes.io/projected/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-kube-api-access-vn9hg\") pod \"maas-controller-54965dc45b-t2gfb\" (UID: \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\") " pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:45.436873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.436847    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zshh\""
Jul 02 17:23:45.445519 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.445496    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:45.470745 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.470717    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-webhook-cert\") pod \"maas-controller-85f9dc7b46-tk2sp\" (UID: \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\") " pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:45.470745 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.470749    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqns\" (UniqueName: \"kubernetes.io/projected/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-kube-api-access-zlqns\") pod \"maas-controller-85f9dc7b46-tk2sp\" (UID: \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\") " pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:45.473135 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.473107    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-webhook-cert\") pod \"maas-controller-85f9dc7b46-tk2sp\" (UID: \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\") " pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:45.478082 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.478051    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlqns\" (UniqueName: \"kubernetes.io/projected/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-kube-api-access-zlqns\") pod \"maas-controller-85f9dc7b46-tk2sp\" (UID: \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\") " pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:45.582521 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.582475    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54965dc45b-t2gfb"]
Jul 02 17:23:45.585441 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:23:45.585412    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67dd01f_21b8_4e09_9a99_4ed4e4246ce8.slice/crio-4c322ba17b42ead936f07d650d33bbae42c85362d41a96bec67b7f7cceeae9bf WatchSource:0}: Error finding container 4c322ba17b42ead936f07d650d33bbae42c85362d41a96bec67b7f7cceeae9bf: Status 404 returned error can't find the container with id 4c322ba17b42ead936f07d650d33bbae42c85362d41a96bec67b7f7cceeae9bf
Jul 02 17:23:45.586768 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.586745    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:23:45.619393 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.619345    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:45.750814 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:45.750779    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-tk2sp"]
Jul 02 17:23:45.753785 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:23:45.753759    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a5bd60_2bd4_48ee_8bb5_6bd7d3caf5ef.slice/crio-c902a3bf8788f81ec3d6a67de9cdd9aefed7db4e1c71a4fe8878a2043212a0b2 WatchSource:0}: Error finding container c902a3bf8788f81ec3d6a67de9cdd9aefed7db4e1c71a4fe8878a2043212a0b2: Status 404 returned error can't find the container with id c902a3bf8788f81ec3d6a67de9cdd9aefed7db4e1c71a4fe8878a2043212a0b2
Jul 02 17:23:46.495026 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:46.494977    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp" event={"ID":"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef","Type":"ContainerStarted","Data":"c902a3bf8788f81ec3d6a67de9cdd9aefed7db4e1c71a4fe8878a2043212a0b2"}
Jul 02 17:23:46.498923 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:46.498889    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54965dc45b-t2gfb" event={"ID":"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8","Type":"ContainerStarted","Data":"4c322ba17b42ead936f07d650d33bbae42c85362d41a96bec67b7f7cceeae9bf"}
Jul 02 17:23:48.320441 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:48.320419    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 17:23:48.511368 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:48.511328    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp" event={"ID":"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef","Type":"ContainerStarted","Data":"96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8"}
Jul 02 17:23:48.511556 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:48.511497    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:48.512957 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:48.512931    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54965dc45b-t2gfb" event={"ID":"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8","Type":"ContainerStarted","Data":"86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43"}
Jul 02 17:23:48.513071 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:48.512981    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:48.543950 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:48.543886    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp" podStartSLOduration=0.974137713 podStartE2EDuration="3.543867542s" totalImagesPullingTime="2.569729829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:23:48.53909741 +0000 UTC m=+783.530057667" watchObservedRunningTime="2026-07-02 17:23:48.543867542 +0000 UTC m=+783.534827796"
Jul 02 17:23:48.571425 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:48.571303    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54965dc45b-t2gfb" podStartSLOduration=0.840179241 podStartE2EDuration="3.571273504s" totalImagesPullingTime="2.731094263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:23:48.570618195 +0000 UTC m=+783.561578478" watchObservedRunningTime="2026-07-02 17:23:48.571273504 +0000 UTC m=+783.562233760"
Jul 02 17:23:59.523675 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.523642    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:59.524123 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.523721    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:23:59.584172 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.584137    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54965dc45b-t2gfb"]
Jul 02 17:23:59.584400 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.584375    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-54965dc45b-t2gfb" podUID="b67dd01f-21b8-4e09-9a99-4ed4e4246ce8" containerName="manager" containerID="cri-o://86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43" gracePeriod=30
Jul 02 17:23:59.834731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.834704    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:23:59.904386 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.904343    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-webhook-cert\") pod \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\" (UID: \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\") "
Jul 02 17:23:59.904569 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.904440    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn9hg\" (UniqueName: \"kubernetes.io/projected/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-kube-api-access-vn9hg\") pod \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\" (UID: \"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8\") "
Jul 02 17:23:59.906583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.906554    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b67dd01f-21b8-4e09-9a99-4ed4e4246ce8" (UID: "b67dd01f-21b8-4e09-9a99-4ed4e4246ce8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:23:59.906583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:23:59.906557    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-kube-api-access-vn9hg" (OuterVolumeSpecName: "kube-api-access-vn9hg") pod "b67dd01f-21b8-4e09-9a99-4ed4e4246ce8" (UID: "b67dd01f-21b8-4e09-9a99-4ed4e4246ce8"). InnerVolumeSpecName "kube-api-access-vn9hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:24:00.005216 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.005180    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn9hg\" (UniqueName: \"kubernetes.io/projected/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-kube-api-access-vn9hg\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:24:00.005216 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.005209    2550 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8-webhook-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:24:00.572380 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.572348    2550 generic.go:356] "Generic (PLEG): container finished" podID="b67dd01f-21b8-4e09-9a99-4ed4e4246ce8" containerID="86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43" exitCode=0
Jul 02 17:24:00.572852 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.572395    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54965dc45b-t2gfb"
Jul 02 17:24:00.572852 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.572405    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54965dc45b-t2gfb" event={"ID":"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8","Type":"ContainerDied","Data":"86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43"}
Jul 02 17:24:00.572852 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.572447    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54965dc45b-t2gfb" event={"ID":"b67dd01f-21b8-4e09-9a99-4ed4e4246ce8","Type":"ContainerDied","Data":"4c322ba17b42ead936f07d650d33bbae42c85362d41a96bec67b7f7cceeae9bf"}
Jul 02 17:24:00.572852 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.572468    2550 scope.go:117] "RemoveContainer" containerID="86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43"
Jul 02 17:24:00.581401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.581384    2550 scope.go:117] "RemoveContainer" containerID="86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43"
Jul 02 17:24:00.581671 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:24:00.581647    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43\": container with ID starting with 86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43 not found: ID does not exist" containerID="86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43"
Jul 02 17:24:00.581738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.581671    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43"} err="failed to get container status \"86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43\": rpc error: code = NotFound desc = could not find container \"86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43\": container with ID starting with 86eed435c6eac447051bb2df9bf08448710de42a50ea95f0d212f4a0025edb43 not found: ID does not exist"
Jul 02 17:24:00.592718 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.592692    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54965dc45b-t2gfb"]
Jul 02 17:24:00.598281 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:00.598259    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54965dc45b-t2gfb"]
Jul 02 17:24:01.454126 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:01.454081    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b67dd01f-21b8-4e09-9a99-4ed4e4246ce8" path="/var/lib/kubelet/pods/b67dd01f-21b8-4e09-9a99-4ed4e4246ce8/volumes"
Jul 02 17:24:20.560656 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.560549    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7ff58cd6f4-7rjqh"]
Jul 02 17:24:20.561130 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.561052    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b67dd01f-21b8-4e09-9a99-4ed4e4246ce8" containerName="manager"
Jul 02 17:24:20.561130 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.561072    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="b67dd01f-21b8-4e09-9a99-4ed4e4246ce8" containerName="manager"
Jul 02 17:24:20.561243 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.561165    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="b67dd01f-21b8-4e09-9a99-4ed4e4246ce8" containerName="manager"
Jul 02 17:24:20.564145 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.564124    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:20.567915 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.567894    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 17:24:20.568029 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.567903    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vzs5v\""
Jul 02 17:24:20.577457 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.577434    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7ff58cd6f4-7rjqh"]
Jul 02 17:24:20.685953 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.685914    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n9jq\" (UniqueName: \"kubernetes.io/projected/3a36a944-beb2-439a-b5e1-bc7290106fa6-kube-api-access-8n9jq\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:20.685953 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.685960    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a36a944-beb2-439a-b5e1-bc7290106fa6-openshift-service-ca\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:20.686201 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.685984    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36a944-beb2-439a-b5e1-bc7290106fa6-maas-api-tls\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:20.787292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.787253    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a36a944-beb2-439a-b5e1-bc7290106fa6-openshift-service-ca\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:20.787292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.787300    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36a944-beb2-439a-b5e1-bc7290106fa6-maas-api-tls\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:20.787491 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.787382    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n9jq\" (UniqueName: \"kubernetes.io/projected/3a36a944-beb2-439a-b5e1-bc7290106fa6-kube-api-access-8n9jq\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:20.787523 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:24:20.787493    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 02 17:24:20.787630 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:24:20.787588    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a36a944-beb2-439a-b5e1-bc7290106fa6-maas-api-tls podName:3a36a944-beb2-439a-b5e1-bc7290106fa6 nodeName:}" failed. No retries permitted until 2026-07-02 17:24:21.28756849 +0000 UTC m=+816.278528723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3a36a944-beb2-439a-b5e1-bc7290106fa6-maas-api-tls") pod "maas-api-7ff58cd6f4-7rjqh" (UID: "3a36a944-beb2-439a-b5e1-bc7290106fa6") : secret "maas-api-serving-cert" not found
Jul 02 17:24:20.787941 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.787922    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a36a944-beb2-439a-b5e1-bc7290106fa6-openshift-service-ca\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:20.797855 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:20.797831    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n9jq\" (UniqueName: \"kubernetes.io/projected/3a36a944-beb2-439a-b5e1-bc7290106fa6-kube-api-access-8n9jq\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:21.137613 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.137557    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"]
Jul 02 17:24:21.141079 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.141056    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:21.143080 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.143056    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 17:24:21.143206 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.143060    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6gpw4\""
Jul 02 17:24:21.152400 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.152374    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"]
Jul 02 17:24:21.175125 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.175078    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-zrx99"]
Jul 02 17:24:21.178861 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.178840    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:21.183296 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.183265    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-zrx99"]
Jul 02 17:24:21.190713 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.190688    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c232206-6448-4bec-b5ca-6799fd576adc-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-s2lsq\" (UID: \"8c232206-6448-4bec-b5ca-6799fd576adc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:21.190836 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.190778    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5p6t\" (UniqueName: \"kubernetes.io/projected/8c232206-6448-4bec-b5ca-6799fd576adc-kube-api-access-h5p6t\") pod \"payload-pre-processing-59f49fd4f6-s2lsq\" (UID: \"8c232206-6448-4bec-b5ca-6799fd576adc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:21.291549 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.291498    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c232206-6448-4bec-b5ca-6799fd576adc-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-s2lsq\" (UID: \"8c232206-6448-4bec-b5ca-6799fd576adc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:21.291758 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.291564    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df5bda9-11dc-43bb-8ccd-ba24c55f631f-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-zrx99\" (UID: \"6df5bda9-11dc-43bb-8ccd-ba24c55f631f\") " pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:21.291758 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.291621    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48626\" (UniqueName: \"kubernetes.io/projected/6df5bda9-11dc-43bb-8ccd-ba24c55f631f-kube-api-access-48626\") pod \"payload-processing-7bbcb654f4-zrx99\" (UID: \"6df5bda9-11dc-43bb-8ccd-ba24c55f631f\") " pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:21.291758 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.291708    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36a944-beb2-439a-b5e1-bc7290106fa6-maas-api-tls\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:21.291935 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.291772    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5p6t\" (UniqueName: \"kubernetes.io/projected/8c232206-6448-4bec-b5ca-6799fd576adc-kube-api-access-h5p6t\") pod \"payload-pre-processing-59f49fd4f6-s2lsq\" (UID: \"8c232206-6448-4bec-b5ca-6799fd576adc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:21.292341 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.292317    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c232206-6448-4bec-b5ca-6799fd576adc-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-s2lsq\" (UID: \"8c232206-6448-4bec-b5ca-6799fd576adc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:21.294380 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.294352    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a36a944-beb2-439a-b5e1-bc7290106fa6-maas-api-tls\") pod \"maas-api-7ff58cd6f4-7rjqh\" (UID: \"3a36a944-beb2-439a-b5e1-bc7290106fa6\") " pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:21.299619 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.299577    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5p6t\" (UniqueName: \"kubernetes.io/projected/8c232206-6448-4bec-b5ca-6799fd576adc-kube-api-access-h5p6t\") pod \"payload-pre-processing-59f49fd4f6-s2lsq\" (UID: \"8c232206-6448-4bec-b5ca-6799fd576adc\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:21.392437 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.392360    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df5bda9-11dc-43bb-8ccd-ba24c55f631f-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-zrx99\" (UID: \"6df5bda9-11dc-43bb-8ccd-ba24c55f631f\") " pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:21.392437 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.392393    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48626\" (UniqueName: \"kubernetes.io/projected/6df5bda9-11dc-43bb-8ccd-ba24c55f631f-kube-api-access-48626\") pod \"payload-processing-7bbcb654f4-zrx99\" (UID: \"6df5bda9-11dc-43bb-8ccd-ba24c55f631f\") " pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:21.393098 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.393074    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df5bda9-11dc-43bb-8ccd-ba24c55f631f-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-zrx99\" (UID: \"6df5bda9-11dc-43bb-8ccd-ba24c55f631f\") " pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:21.404405 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.404373    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48626\" (UniqueName: \"kubernetes.io/projected/6df5bda9-11dc-43bb-8ccd-ba24c55f631f-kube-api-access-48626\") pod \"payload-processing-7bbcb654f4-zrx99\" (UID: \"6df5bda9-11dc-43bb-8ccd-ba24c55f631f\") " pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:21.451647 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.451617    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:21.474194 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.474157    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:21.492036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.492008    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:21.624399 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.624368    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"]
Jul 02 17:24:21.666881 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.666697    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7ff58cd6f4-7rjqh"]
Jul 02 17:24:21.671255 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:24:21.667448    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a36a944_beb2_439a_b5e1_bc7290106fa6.slice/crio-8d097da63f4768612373c4280a17a53a199f7ea4f18f988798fe546f97d5b440 WatchSource:0}: Error finding container 8d097da63f4768612373c4280a17a53a199f7ea4f18f988798fe546f97d5b440: Status 404 returned error can't find the container with id 8d097da63f4768612373c4280a17a53a199f7ea4f18f988798fe546f97d5b440
Jul 02 17:24:21.671255 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.668155    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq" event={"ID":"8c232206-6448-4bec-b5ca-6799fd576adc","Type":"ContainerStarted","Data":"137d7c96638901f093025a51fe16ac3a5853f290a744d3879a88bea2d26ad4ef"}
Jul 02 17:24:21.712746 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:21.709462    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-zrx99"]
Jul 02 17:24:22.685989 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:22.685851    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99" event={"ID":"6df5bda9-11dc-43bb-8ccd-ba24c55f631f","Type":"ContainerStarted","Data":"9681bc4b7bf6e60cb047725e3c47764d403c21a64d183b3221e056039ee83563"}
Jul 02 17:24:22.688324 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:22.688290    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7ff58cd6f4-7rjqh" event={"ID":"3a36a944-beb2-439a-b5e1-bc7290106fa6","Type":"ContainerStarted","Data":"8d097da63f4768612373c4280a17a53a199f7ea4f18f988798fe546f97d5b440"}
Jul 02 17:24:25.727576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.727541    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq" event={"ID":"8c232206-6448-4bec-b5ca-6799fd576adc","Type":"ContainerStarted","Data":"fb91ddc95c715cdb0d4943d51dc803ef9bee77d7e84eb7bf20d4c7e53ee8104c"}
Jul 02 17:24:25.728047 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.727639    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:24:25.729084 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.729061    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99" event={"ID":"6df5bda9-11dc-43bb-8ccd-ba24c55f631f","Type":"ContainerStarted","Data":"cb848685f38eb4a67c59b7008cf476c3fea7106e1c562ce481600754ed081dd6"}
Jul 02 17:24:25.729196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.729125    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:25.730613 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.730576    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7ff58cd6f4-7rjqh" event={"ID":"3a36a944-beb2-439a-b5e1-bc7290106fa6","Type":"ContainerStarted","Data":"2a0c7322ee26a9dbe43260eebc7ab99de97245d46598d246e9f74ff4f672cb28"}
Jul 02 17:24:25.730731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.730714    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:25.741148 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.741097    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq" podStartSLOduration=1.09079028 podStartE2EDuration="4.741079079s" totalImagesPullingTime="3.650288799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:24:25.740634907 +0000 UTC m=+820.731595188" watchObservedRunningTime="2026-07-02 17:24:25.741079079 +0000 UTC m=+820.732039335"
Jul 02 17:24:25.754404 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.754357    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99" podStartSLOduration=1.180454972 podStartE2EDuration="4.754341413s" totalImagesPullingTime="3.573886441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:24:25.75297689 +0000 UTC m=+820.743937170" watchObservedRunningTime="2026-07-02 17:24:25.754341413 +0000 UTC m=+820.745301667"
Jul 02 17:24:25.766980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:25.766939    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7ff58cd6f4-7rjqh" podStartSLOduration=2.187368864 podStartE2EDuration="5.766925729s" totalImagesPullingTime="3.579556865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:24:25.765682381 +0000 UTC m=+820.756642654" watchObservedRunningTime="2026-07-02 17:24:25.766925729 +0000 UTC m=+820.757885984"
Jul 02 17:24:28.747297 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:28.747264    2550 generic.go:356] "Generic (PLEG): container finished" podID="aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a" containerID="08e76a574dec7f7bb1f7b50028e4820df10ffe7d43348e196a170c8ee67b054a" exitCode=0
Jul 02 17:24:28.747698 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:28.747328    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" event={"ID":"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a","Type":"ContainerDied","Data":"08e76a574dec7f7bb1f7b50028e4820df10ffe7d43348e196a170c8ee67b054a"}
Jul 02 17:24:28.747740 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:28.747724    2550 scope.go:117] "RemoveContainer" containerID="08e76a574dec7f7bb1f7b50028e4820df10ffe7d43348e196a170c8ee67b054a"
Jul 02 17:24:28.748772 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:28.748744    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:24:28.748846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:28.748829    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:24:28.748898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:28.748882    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:24:29.754090 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:29.754029    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" event={"ID":"aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a","Type":"ContainerStarted","Data":"44fbafc95ab594d35d53debca89542b4e5fb109ddb8f97c68b4a340838410e9a"}
Jul 02 17:24:29.905438 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:29.904897    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:24:29.905670 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:29.905383    2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pmht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 02 17:24:29.905670 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:29.905575    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" podUID="aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 02 17:24:30.904580 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:30.904537    2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pmht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 02 17:24:30.905226 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:30.905185    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" podUID="aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 02 17:24:31.742442 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:31.742411    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7ff58cd6f4-7rjqh"
Jul 02 17:24:31.905252 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:31.905211    2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pmht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 02 17:24:31.905831 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:31.905798    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" podUID="aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 02 17:24:32.904536 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:32.904497    2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pmht6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body=
Jul 02 17:24:32.904877 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:32.904846    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6" podUID="aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused"
Jul 02 17:24:33.908007 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:33.907978    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:24:33.908393 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:33.908336    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:24:33.908996 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:33.908980    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pmht6"
Jul 02 17:24:36.738729 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:36.738697    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-zrx99"
Jul 02 17:24:36.739190 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:24:36.738775    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-s2lsq"
Jul 02 17:25:45.469102 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:25:45.469027    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:25:45.469886 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:25:45.469863    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:26:10.038978 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.038937    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"]
Jul 02 17:26:10.041369 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.041348    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.043313 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.043293    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 17:26:10.043489 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.043470    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 17:26:10.043989 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.043972    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 02 17:26:10.044095 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.044024    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gfvgc\""
Jul 02 17:26:10.052818 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.052787    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"]
Jul 02 17:26:10.192494 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.192449    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.192703 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.192558    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.192703 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.192588    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.192703 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.192641    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.192869 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.192780    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0985ac1a-605a-485d-a109-3096143c91ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.192869 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.192827    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmghg\" (UniqueName: \"kubernetes.io/projected/0985ac1a-605a-485d-a109-3096143c91ef-kube-api-access-pmghg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294035 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.293942    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294035 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.294003    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0985ac1a-605a-485d-a109-3096143c91ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294035 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.294029    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmghg\" (UniqueName: \"kubernetes.io/projected/0985ac1a-605a-485d-a109-3096143c91ef-kube-api-access-pmghg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294388 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.294055    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294388 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.294103    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294388 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.294133    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.294469    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.294512    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.294583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.294539    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.296173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.296154    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0985ac1a-605a-485d-a109-3096143c91ef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.296524 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.296507    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0985ac1a-605a-485d-a109-3096143c91ef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.300937 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.300910    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmghg\" (UniqueName: \"kubernetes.io/projected/0985ac1a-605a-485d-a109-3096143c91ef-kube-api-access-pmghg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l\" (UID: \"0985ac1a-605a-485d-a109-3096143c91ef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.352676 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.352637    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:10.483747 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:10.483717    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"]
Jul 02 17:26:10.486230 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:26:10.486201    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0985ac1a_605a_485d_a109_3096143c91ef.slice/crio-9181f1cd21bdf27b10b6d2fa013eea1060f144ca0d2b5f0bb82c9560f44d51f1 WatchSource:0}: Error finding container 9181f1cd21bdf27b10b6d2fa013eea1060f144ca0d2b5f0bb82c9560f44d51f1: Status 404 returned error can't find the container with id 9181f1cd21bdf27b10b6d2fa013eea1060f144ca0d2b5f0bb82c9560f44d51f1
Jul 02 17:26:11.207318 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:11.207279    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l" event={"ID":"0985ac1a-605a-485d-a109-3096143c91ef","Type":"ContainerStarted","Data":"9181f1cd21bdf27b10b6d2fa013eea1060f144ca0d2b5f0bb82c9560f44d51f1"}
Jul 02 17:26:12.213681 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:12.213638    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l" event={"ID":"0985ac1a-605a-485d-a109-3096143c91ef","Type":"ContainerStarted","Data":"b41ffab434626b552263c804799e806bb77a27d8c8472f8cd89f5d6c6b7af5f0"}
Jul 02 17:26:12.240341 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:12.240266    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l" podStartSLOduration=1.246086769 podStartE2EDuration="2.240246497s" totalImagesPullingTime="994.159728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:26:12.23940026 +0000 UTC m=+927.230360528" watchObservedRunningTime="2026-07-02 17:26:12.240246497 +0000 UTC m=+927.231206753"
Jul 02 17:26:20.353790 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:20.353751    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:20.354293 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:20.353816    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:20.366455 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:20.366427    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:26:21.267015 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:26:21.266988    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l"
Jul 02 17:28:32.314948 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.314911    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-tk2sp"]
Jul 02 17:28:32.315531 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.315203    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp" podUID="d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef" containerName="manager" containerID="cri-o://96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8" gracePeriod=30
Jul 02 17:28:32.561165 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.561139    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:28:32.668905 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.668871    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-webhook-cert\") pod \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\" (UID: \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\") "
Jul 02 17:28:32.669081 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.668915    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlqns\" (UniqueName: \"kubernetes.io/projected/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-kube-api-access-zlqns\") pod \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\" (UID: \"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef\") "
Jul 02 17:28:32.670997 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.670969    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef" (UID: "d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:28:32.671111 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.671004    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-kube-api-access-zlqns" (OuterVolumeSpecName: "kube-api-access-zlqns") pod "d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef" (UID: "d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef"). InnerVolumeSpecName "kube-api-access-zlqns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:28:32.769803 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.769766    2550 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-webhook-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:28:32.769803 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.769797    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlqns\" (UniqueName: \"kubernetes.io/projected/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef-kube-api-access-zlqns\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:28:32.858793 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.858758    2550 generic.go:356] "Generic (PLEG): container finished" podID="d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef" containerID="96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8" exitCode=0
Jul 02 17:28:32.858986 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.858800    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp"
Jul 02 17:28:32.858986 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.858845    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp" event={"ID":"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef","Type":"ContainerDied","Data":"96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8"}
Jul 02 17:28:32.858986 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.858903    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f9dc7b46-tk2sp" event={"ID":"d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef","Type":"ContainerDied","Data":"c902a3bf8788f81ec3d6a67de9cdd9aefed7db4e1c71a4fe8878a2043212a0b2"}
Jul 02 17:28:32.858986 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.858934    2550 scope.go:117] "RemoveContainer" containerID="96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8"
Jul 02 17:28:32.868034 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.868017    2550 scope.go:117] "RemoveContainer" containerID="96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8"
Jul 02 17:28:32.868282 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:28:32.868265    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8\": container with ID starting with 96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8 not found: ID does not exist" containerID="96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8"
Jul 02 17:28:32.868339 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.868291    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8"} err="failed to get container status \"96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8\": rpc error: code = NotFound desc = could not find container \"96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8\": container with ID starting with 96c766f15e698755bf48adf484f57c19c3e1c03c211b7b7f1b87f2e42f9aa8d8 not found: ID does not exist"
Jul 02 17:28:32.877817 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.877792    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-tk2sp"]
Jul 02 17:28:32.880759 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:32.880740    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-tk2sp"]
Jul 02 17:28:33.454905 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.454869    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef" path="/var/lib/kubelet/pods/d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef/volumes"
Jul 02 17:28:33.627031 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.626994    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-fv8tm"]
Jul 02 17:28:33.627354 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.627341    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef" containerName="manager"
Jul 02 17:28:33.627397 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.627356    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef" containerName="manager"
Jul 02 17:28:33.627430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.627414    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a5bd60-2bd4-48ee-8bb5-6bd7d3caf5ef" containerName="manager"
Jul 02 17:28:33.630235 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.630215    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:33.632413 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.632396    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8zshh\""
Jul 02 17:28:33.632519 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.632397    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 17:28:33.632519 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.632397    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 17:28:33.639625 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.639587    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-fv8tm"]
Jul 02 17:28:33.778961 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.778879    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdchm\" (UniqueName: \"kubernetes.io/projected/5f92d32f-433b-4c85-955e-1f2315dda012-kube-api-access-tdchm\") pod \"maas-controller-85f9dc7b46-fv8tm\" (UID: \"5f92d32f-433b-4c85-955e-1f2315dda012\") " pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:33.778961 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.778934    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f92d32f-433b-4c85-955e-1f2315dda012-webhook-cert\") pod \"maas-controller-85f9dc7b46-fv8tm\" (UID: \"5f92d32f-433b-4c85-955e-1f2315dda012\") " pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:33.879886 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.879853    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdchm\" (UniqueName: \"kubernetes.io/projected/5f92d32f-433b-4c85-955e-1f2315dda012-kube-api-access-tdchm\") pod \"maas-controller-85f9dc7b46-fv8tm\" (UID: \"5f92d32f-433b-4c85-955e-1f2315dda012\") " pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:33.880058 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.879910    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f92d32f-433b-4c85-955e-1f2315dda012-webhook-cert\") pod \"maas-controller-85f9dc7b46-fv8tm\" (UID: \"5f92d32f-433b-4c85-955e-1f2315dda012\") " pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:33.882374 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.882349    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f92d32f-433b-4c85-955e-1f2315dda012-webhook-cert\") pod \"maas-controller-85f9dc7b46-fv8tm\" (UID: \"5f92d32f-433b-4c85-955e-1f2315dda012\") " pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:33.886918 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.886896    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdchm\" (UniqueName: \"kubernetes.io/projected/5f92d32f-433b-4c85-955e-1f2315dda012-kube-api-access-tdchm\") pod \"maas-controller-85f9dc7b46-fv8tm\" (UID: \"5f92d32f-433b-4c85-955e-1f2315dda012\") " pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:33.940962 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:33.940921    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:34.071893 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:34.071704    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85f9dc7b46-fv8tm"]
Jul 02 17:28:34.074508 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:28:34.074480    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f92d32f_433b_4c85_955e_1f2315dda012.slice/crio-a3e9783cc77956c5552614cbc4dd606ed62038a5ed9a507b4c6d940515f6ba0b WatchSource:0}: Error finding container a3e9783cc77956c5552614cbc4dd606ed62038a5ed9a507b4c6d940515f6ba0b: Status 404 returned error can't find the container with id a3e9783cc77956c5552614cbc4dd606ed62038a5ed9a507b4c6d940515f6ba0b
Jul 02 17:28:34.870419 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:34.870387    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f9dc7b46-fv8tm" event={"ID":"5f92d32f-433b-4c85-955e-1f2315dda012","Type":"ContainerStarted","Data":"4727c9103e1ed536df6b2daa40615cf55b8fb82d2fb9484c838724a47f2d24be"}
Jul 02 17:28:34.870960 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:34.870441    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85f9dc7b46-fv8tm" event={"ID":"5f92d32f-433b-4c85-955e-1f2315dda012","Type":"ContainerStarted","Data":"a3e9783cc77956c5552614cbc4dd606ed62038a5ed9a507b4c6d940515f6ba0b"}
Jul 02 17:28:34.870960 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:34.870487    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:28:34.886285 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:34.886234    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85f9dc7b46-fv8tm" podStartSLOduration=1.399611112 podStartE2EDuration="1.886218114s" totalImagesPullingTime="486.607002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:28:34.884263734 +0000 UTC m=+1069.875224001" watchObservedRunningTime="2026-07-02 17:28:34.886218114 +0000 UTC m=+1069.877178429"
Jul 02 17:28:45.880967 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:28:45.880933    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85f9dc7b46-fv8tm"
Jul 02 17:30:00.139231 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.139197    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29716890-gpc85"]
Jul 02 17:30:00.145672 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.143829    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716890-gpc85"
Jul 02 17:30:00.153619 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.153560    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716890-gpc85"]
Jul 02 17:30:00.254946 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.254894    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8hm\" (UniqueName: \"kubernetes.io/projected/4bed1856-b159-4297-b887-0f901bd4e1b9-kube-api-access-7d8hm\") pod \"maas-api-key-cleanup-29716890-gpc85\" (UID: \"4bed1856-b159-4297-b887-0f901bd4e1b9\") " pod="opendatahub/maas-api-key-cleanup-29716890-gpc85"
Jul 02 17:30:00.355853 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.355818    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8hm\" (UniqueName: \"kubernetes.io/projected/4bed1856-b159-4297-b887-0f901bd4e1b9-kube-api-access-7d8hm\") pod \"maas-api-key-cleanup-29716890-gpc85\" (UID: \"4bed1856-b159-4297-b887-0f901bd4e1b9\") " pod="opendatahub/maas-api-key-cleanup-29716890-gpc85"
Jul 02 17:30:00.363938 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.363906    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8hm\" (UniqueName: \"kubernetes.io/projected/4bed1856-b159-4297-b887-0f901bd4e1b9-kube-api-access-7d8hm\") pod \"maas-api-key-cleanup-29716890-gpc85\" (UID: \"4bed1856-b159-4297-b887-0f901bd4e1b9\") " pod="opendatahub/maas-api-key-cleanup-29716890-gpc85"
Jul 02 17:30:00.456143 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.456058    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716890-gpc85"
Jul 02 17:30:00.590119 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.590091    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29716890-gpc85"]
Jul 02 17:30:00.592416 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:30:00.592391    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bed1856_b159_4297_b887_0f901bd4e1b9.slice/crio-f56e0aa19adea910c257ac81723121c308b5995ca8c72d85fcebac882c1ff8d4 WatchSource:0}: Error finding container f56e0aa19adea910c257ac81723121c308b5995ca8c72d85fcebac882c1ff8d4: Status 404 returned error can't find the container with id f56e0aa19adea910c257ac81723121c308b5995ca8c72d85fcebac882c1ff8d4
Jul 02 17:30:00.594340 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:00.594323    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:30:01.268288 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:01.268255    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716890-gpc85" event={"ID":"4bed1856-b159-4297-b887-0f901bd4e1b9","Type":"ContainerStarted","Data":"f56e0aa19adea910c257ac81723121c308b5995ca8c72d85fcebac882c1ff8d4"}
Jul 02 17:30:04.285538 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:04.285506    2550 generic.go:356] "Generic (PLEG): container finished" podID="4bed1856-b159-4297-b887-0f901bd4e1b9" containerID="9e5de103594b117d0435216c557f54afc93971fc8af0c2a17a4fdc0c105ff548" exitCode=0
Jul 02 17:30:04.285945 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:04.285578    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716890-gpc85" event={"ID":"4bed1856-b159-4297-b887-0f901bd4e1b9","Type":"ContainerDied","Data":"9e5de103594b117d0435216c557f54afc93971fc8af0c2a17a4fdc0c105ff548"}
Jul 02 17:30:05.420411 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:05.420390    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716890-gpc85"
Jul 02 17:30:05.502431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:05.502397    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d8hm\" (UniqueName: \"kubernetes.io/projected/4bed1856-b159-4297-b887-0f901bd4e1b9-kube-api-access-7d8hm\") pod \"4bed1856-b159-4297-b887-0f901bd4e1b9\" (UID: \"4bed1856-b159-4297-b887-0f901bd4e1b9\") "
Jul 02 17:30:05.504462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:05.504436    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bed1856-b159-4297-b887-0f901bd4e1b9-kube-api-access-7d8hm" (OuterVolumeSpecName: "kube-api-access-7d8hm") pod "4bed1856-b159-4297-b887-0f901bd4e1b9" (UID: "4bed1856-b159-4297-b887-0f901bd4e1b9"). InnerVolumeSpecName "kube-api-access-7d8hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:30:05.603763 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:05.603679    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d8hm\" (UniqueName: \"kubernetes.io/projected/4bed1856-b159-4297-b887-0f901bd4e1b9-kube-api-access-7d8hm\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:30:06.296367 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:06.296315    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29716890-gpc85" event={"ID":"4bed1856-b159-4297-b887-0f901bd4e1b9","Type":"ContainerDied","Data":"f56e0aa19adea910c257ac81723121c308b5995ca8c72d85fcebac882c1ff8d4"}
Jul 02 17:30:06.296564 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:06.296433    2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f56e0aa19adea910c257ac81723121c308b5995ca8c72d85fcebac882c1ff8d4"
Jul 02 17:30:06.296564 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:06.296521    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29716890-gpc85"
Jul 02 17:30:45.497293 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:45.497266    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:30:45.499804 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:30:45.499783    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:35:45.527401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:35:45.527368    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:35:45.530261 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:35:45.530241    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:40:37.134145 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.134044    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"]
Jul 02 17:40:37.134735 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.134420    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bed1856-b159-4297-b887-0f901bd4e1b9" containerName="cleanup"
Jul 02 17:40:37.134735 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.134432    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bed1856-b159-4297-b887-0f901bd4e1b9" containerName="cleanup"
Jul 02 17:40:37.134735 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.134531    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bed1856-b159-4297-b887-0f901bd4e1b9" containerName="cleanup"
Jul 02 17:40:37.137712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.137690    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.147408 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.147269    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cd0fac7e-openshift-default-dockercfg-dd9zv\""
Jul 02 17:40:37.188724 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.188692    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"]
Jul 02 17:40:37.192974 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.192946    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-credential-socket\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.193109 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.192979    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-envoy\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.193109 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.193002    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-certs\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.193109 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.193021    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6pmb\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-kube-api-access-n6pmb\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.193109 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.193040    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-socket\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.193109 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.193093    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-token\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.193276 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.193170    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-data\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.193276 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.193259    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istiod-ca-cert\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.193337 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.193291    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-podinfo\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.294581 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294546    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-credential-socket\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.294581 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294582    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-envoy\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.294847 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294640    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-certs\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.294847 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294672    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6pmb\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-kube-api-access-n6pmb\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.294847 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294700    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-socket\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.294847 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294723    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-token\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.294847 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294755    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-data\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.294847 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294840    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istiod-ca-cert\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.295151 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.294874    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-podinfo\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.295151 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.295102    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-certs\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.295250 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.295210    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-socket\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.295250 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.295238    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-data\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.295346 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.295329    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-credential-socket\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.295538 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.295516    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istiod-ca-cert\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.297003 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.296982    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-envoy\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.297286 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.297267    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-podinfo\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.316556 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.316528    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-token\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.319880 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.319854    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6pmb\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-kube-api-access-n6pmb\") pod \"e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") " pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.451154 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.451069    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:37.585139 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.585116    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"]
Jul 02 17:40:37.587200 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:40:37.587172    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b6c66a_1afc_4b5c_a201_7d8b1f51152e.slice/crio-1379e4abec9a6aa780390111b2807ec8d6847785c1ea7543a628f8f468b0006a WatchSource:0}: Error finding container 1379e4abec9a6aa780390111b2807ec8d6847785c1ea7543a628f8f468b0006a: Status 404 returned error can't find the container with id 1379e4abec9a6aa780390111b2807ec8d6847785c1ea7543a628f8f468b0006a
Jul 02 17:40:37.589149 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.589120    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:40:37.589211 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.589187    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:40:37.589249 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:37.589214    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:40:38.182045 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.182010    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq" event={"ID":"52b6c66a-1afc-4b5c-a201-7d8b1f51152e","Type":"ContainerStarted","Data":"8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d"}
Jul 02 17:40:38.182453 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.182069    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq" event={"ID":"52b6c66a-1afc-4b5c-a201-7d8b1f51152e","Type":"ContainerStarted","Data":"1379e4abec9a6aa780390111b2807ec8d6847785c1ea7543a628f8f468b0006a"}
Jul 02 17:40:38.202609 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.202529    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq" podStartSLOduration=1.202506208 podStartE2EDuration="1.202506208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:40:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:40:38.201768681 +0000 UTC m=+1793.192728938" watchObservedRunningTime="2026-07-02 17:40:38.202506208 +0000 UTC m=+1793.193466458"
Jul 02 17:40:38.452136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.452045    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:38.457128 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.457102    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:38.555330 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.555288    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"]
Jul 02 17:40:38.559202 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.559178    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:38.561088 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.561057    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-cd0fac7e-serving-cert\""
Jul 02 17:40:38.567950 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.567916    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"]
Jul 02 17:40:38.707684 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.707561    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-696lm\" (UniqueName: \"kubernetes.io/projected/363c2944-51e4-4dd1-bfd5-c304d7373c49-kube-api-access-696lm\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:38.707850 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.707705    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:38.707850 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.707749    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/363c2944-51e4-4dd1-bfd5-c304d7373c49-openshift-service-ca\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:38.808675 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.808636    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-696lm\" (UniqueName: \"kubernetes.io/projected/363c2944-51e4-4dd1-bfd5-c304d7373c49-kube-api-access-696lm\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:38.808862 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.808699    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:38.808862 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.808726    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/363c2944-51e4-4dd1-bfd5-c304d7373c49-openshift-service-ca\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:38.808983 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:40:38.808873    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-cd0fac7e-serving-cert: secret "maas-api-e2e-ait-cd0fac7e-serving-cert" not found
Jul 02 17:40:38.808983 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:40:38.808950    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls podName:363c2944-51e4-4dd1-bfd5-c304d7373c49 nodeName:}" failed. No retries permitted until 2026-07-02 17:40:39.308928394 +0000 UTC m=+1794.299888631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls") pod "maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q" (UID: "363c2944-51e4-4dd1-bfd5-c304d7373c49") : secret "maas-api-e2e-ait-cd0fac7e-serving-cert" not found
Jul 02 17:40:38.809470 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.809451    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/363c2944-51e4-4dd1-bfd5-c304d7373c49-openshift-service-ca\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:38.819364 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:38.819327    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-696lm\" (UniqueName: \"kubernetes.io/projected/363c2944-51e4-4dd1-bfd5-c304d7373c49-kube-api-access-696lm\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:39.187300 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:39.187269    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:39.188279 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:39.188259    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:39.314254 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:39.314221    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:39.316764 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:39.316733    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls\") pod \"maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") " pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:39.472770 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:39.472688    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:39.606473 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:39.606448    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"]
Jul 02 17:40:39.608815 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:40:39.608776    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363c2944_51e4_4dd1_bfd5_c304d7373c49.slice/crio-217e085e078b12226b0ae6387afac984eeab4769aa6720ccb1d89a4447c96521 WatchSource:0}: Error finding container 217e085e078b12226b0ae6387afac984eeab4769aa6720ccb1d89a4447c96521: Status 404 returned error can't find the container with id 217e085e078b12226b0ae6387afac984eeab4769aa6720ccb1d89a4447c96521
Jul 02 17:40:39.610748 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:39.610723    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:40:40.193680 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:40.193649    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q" event={"ID":"363c2944-51e4-4dd1-bfd5-c304d7373c49","Type":"ContainerStarted","Data":"217e085e078b12226b0ae6387afac984eeab4769aa6720ccb1d89a4447c96521"}
Jul 02 17:40:41.199870 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:41.199831    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q" event={"ID":"363c2944-51e4-4dd1-bfd5-c304d7373c49","Type":"ContainerStarted","Data":"6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd"}
Jul 02 17:40:41.200290 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:41.200078    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:41.217701 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:41.217653    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q" podStartSLOduration=2.666860591 podStartE2EDuration="3.217638191s" totalImagesPullingTime="550.7776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:40:41.215887069 +0000 UTC m=+1796.206847324" watchObservedRunningTime="2026-07-02 17:40:41.217638191 +0000 UTC m=+1796.208598447"
Jul 02 17:40:43.627957 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:43.627919    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"]
Jul 02 17:40:43.628536 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:43.628162    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq" podUID="52b6c66a-1afc-4b5c-a201-7d8b1f51152e" containerName="istio-proxy" containerID="cri-o://8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d" gracePeriod=30
Jul 02 17:40:43.802744 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:43.802710    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"]
Jul 02 17:40:43.803291 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:43.803213    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q" podUID="363c2944-51e4-4dd1-bfd5-c304d7373c49" containerName="maas-api" containerID="cri-o://6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd" gracePeriod=30
Jul 02 17:40:44.074553 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.074526    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:44.159993 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.159903    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-696lm\" (UniqueName: \"kubernetes.io/projected/363c2944-51e4-4dd1-bfd5-c304d7373c49-kube-api-access-696lm\") pod \"363c2944-51e4-4dd1-bfd5-c304d7373c49\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") "
Jul 02 17:40:44.159993 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.159936    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls\") pod \"363c2944-51e4-4dd1-bfd5-c304d7373c49\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") "
Jul 02 17:40:44.160175 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.160014    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/363c2944-51e4-4dd1-bfd5-c304d7373c49-openshift-service-ca\") pod \"363c2944-51e4-4dd1-bfd5-c304d7373c49\" (UID: \"363c2944-51e4-4dd1-bfd5-c304d7373c49\") "
Jul 02 17:40:44.160419 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.160394    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/363c2944-51e4-4dd1-bfd5-c304d7373c49-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "363c2944-51e4-4dd1-bfd5-c304d7373c49" (UID: "363c2944-51e4-4dd1-bfd5-c304d7373c49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:40:44.162097 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.162068    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "363c2944-51e4-4dd1-bfd5-c304d7373c49" (UID: "363c2944-51e4-4dd1-bfd5-c304d7373c49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:40:44.162212 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.162150    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/363c2944-51e4-4dd1-bfd5-c304d7373c49-kube-api-access-696lm" (OuterVolumeSpecName: "kube-api-access-696lm") pod "363c2944-51e4-4dd1-bfd5-c304d7373c49" (UID: "363c2944-51e4-4dd1-bfd5-c304d7373c49"). InnerVolumeSpecName "kube-api-access-696lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:40:44.221086 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.221041    2550 generic.go:356] "Generic (PLEG): container finished" podID="363c2944-51e4-4dd1-bfd5-c304d7373c49" containerID="6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd" exitCode=0
Jul 02 17:40:44.221285 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.221145    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"
Jul 02 17:40:44.221285 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.221147    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q" event={"ID":"363c2944-51e4-4dd1-bfd5-c304d7373c49","Type":"ContainerDied","Data":"6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd"}
Jul 02 17:40:44.221431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.221298    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q" event={"ID":"363c2944-51e4-4dd1-bfd5-c304d7373c49","Type":"ContainerDied","Data":"217e085e078b12226b0ae6387afac984eeab4769aa6720ccb1d89a4447c96521"}
Jul 02 17:40:44.221431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.221339    2550 scope.go:117] "RemoveContainer" containerID="6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd"
Jul 02 17:40:44.231158 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.231138    2550 scope.go:117] "RemoveContainer" containerID="6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd"
Jul 02 17:40:44.231419 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:40:44.231400    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd\": container with ID starting with 6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd not found: ID does not exist" containerID="6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd"
Jul 02 17:40:44.231481 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.231433    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd"} err="failed to get container status \"6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd\": rpc error: code = NotFound desc = could not find container \"6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd\": container with ID starting with 6d307478178dbbf102eabe55a156f079185d486a163400143721ef4f38dc4dcd not found: ID does not exist"
Jul 02 17:40:44.242103 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.242076    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"]
Jul 02 17:40:44.245320 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.245297    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-cd0fac7e-7cc86dcb76-blx2q"]
Jul 02 17:40:44.261576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.261552    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-696lm\" (UniqueName: \"kubernetes.io/projected/363c2944-51e4-4dd1-bfd5-c304d7373c49-kube-api-access-696lm\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:44.261576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.261577    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/363c2944-51e4-4dd1-bfd5-c304d7373c49-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:44.261726 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:44.261602    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/363c2944-51e4-4dd1-bfd5-c304d7373c49-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:45.454586 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:45.454552    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="363c2944-51e4-4dd1-bfd5-c304d7373c49" path="/var/lib/kubelet/pods/363c2944-51e4-4dd1-bfd5-c304d7373c49/volumes"
Jul 02 17:40:45.564694 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:45.564559    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:40:45.577899 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:45.567986    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:40:48.879372 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:48.879316    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:49.007398 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007303    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-envoy\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007398 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007360    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-credential-socket\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007398 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007392    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-socket\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007418    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-token\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007474    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istiod-ca-cert\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007565    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6pmb\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-kube-api-access-n6pmb\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007608    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-podinfo\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007643    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-certs\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007680    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-data\") pod \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\" (UID: \"52b6c66a-1afc-4b5c-a201-7d8b1f51152e\") "
Jul 02 17:40:49.007712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007693    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:40:49.008057 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007712    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:40:49.008057 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007937    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.008057 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.007953    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.008214 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.008078    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:40:49.008214 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.008157    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:40:49.008755 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.008727    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-data" (OuterVolumeSpecName: "istio-data") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:40:49.010163 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.010123    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:40:49.010283 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.010255    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-kube-api-access-n6pmb" (OuterVolumeSpecName: "kube-api-access-n6pmb") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "kube-api-access-n6pmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:40:49.010347 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.010277    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-token" (OuterVolumeSpecName: "istio-token") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:40:49.010347 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.010304    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52b6c66a-1afc-4b5c-a201-7d8b1f51152e" (UID: "52b6c66a-1afc-4b5c-a201-7d8b1f51152e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:40:49.108928 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.108890    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6pmb\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-kube-api-access-n6pmb\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.108928 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.108923    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.109146 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.108940    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.109146 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.108953    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.109146 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.108964    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.109146 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.108974    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.109146 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.108984    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52b6c66a-1afc-4b5c-a201-7d8b1f51152e-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:49.246711 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.246675    2550 generic.go:356] "Generic (PLEG): container finished" podID="52b6c66a-1afc-4b5c-a201-7d8b1f51152e" containerID="8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d" exitCode=0
Jul 02 17:40:49.246874 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.246725    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq" event={"ID":"52b6c66a-1afc-4b5c-a201-7d8b1f51152e","Type":"ContainerDied","Data":"8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d"}
Jul 02 17:40:49.246874 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.246753    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"
Jul 02 17:40:49.246874 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.246791    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq" event={"ID":"52b6c66a-1afc-4b5c-a201-7d8b1f51152e","Type":"ContainerDied","Data":"1379e4abec9a6aa780390111b2807ec8d6847785c1ea7543a628f8f468b0006a"}
Jul 02 17:40:49.246874 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.246813    2550 scope.go:117] "RemoveContainer" containerID="8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d"
Jul 02 17:40:49.256630 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.256605    2550 scope.go:117] "RemoveContainer" containerID="8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d"
Jul 02 17:40:49.256921 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:40:49.256900    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d\": container with ID starting with 8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d not found: ID does not exist" containerID="8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d"
Jul 02 17:40:49.256965 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.256930    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d"} err="failed to get container status \"8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d\": rpc error: code = NotFound desc = could not find container \"8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d\": container with ID starting with 8a089dfed1ced8d8c84943d5b52c3685e9c144b34c770692185d8972487b539d not found: ID does not exist"
Jul 02 17:40:49.267513 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.267443    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"]
Jul 02 17:40:49.273028 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.273005    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cd0fac7e-openshift-default-685ff65797-9qhwq"]
Jul 02 17:40:49.454837 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.454799    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52b6c66a-1afc-4b5c-a201-7d8b1f51152e" path="/var/lib/kubelet/pods/52b6c66a-1afc-4b5c-a201-7d8b1f51152e/volumes"
Jul 02 17:40:49.603514 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.603424    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"]
Jul 02 17:40:49.603802 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.603787    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52b6c66a-1afc-4b5c-a201-7d8b1f51152e" containerName="istio-proxy"
Jul 02 17:40:49.603802 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.603801    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="52b6c66a-1afc-4b5c-a201-7d8b1f51152e" containerName="istio-proxy"
Jul 02 17:40:49.603936 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.603823    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="363c2944-51e4-4dd1-bfd5-c304d7373c49" containerName="maas-api"
Jul 02 17:40:49.603936 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.603829    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="363c2944-51e4-4dd1-bfd5-c304d7373c49" containerName="maas-api"
Jul 02 17:40:49.603936 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.603881    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="363c2944-51e4-4dd1-bfd5-c304d7373c49" containerName="maas-api"
Jul 02 17:40:49.603936 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.603892    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="52b6c66a-1afc-4b5c-a201-7d8b1f51152e" containerName="istio-proxy"
Jul 02 17:40:49.606854 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.606825    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.608864 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.608838    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-243563a0-openshift-default-dockercfg-r7x5r\""
Jul 02 17:40:49.619076 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.619045    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"]
Jul 02 17:40:49.714892 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.714851    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-certs\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.715062 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.714925    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-podinfo\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.715062 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.714993    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2878a8c6-f649-4597-a63f-4a166f80aedf-istiod-ca-cert\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.715062 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.715042    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-envoy\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.715204 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.715082    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7j7w\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-kube-api-access-c7j7w\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.715204 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.715148    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-token\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.715289 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.715258    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-socket\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.715289 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.715280    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-credential-socket\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.715358 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.715294    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-data\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.816704 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816665    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-socket\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.816704 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816705    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-credential-socket\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.816940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816731    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-data\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.816940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816774    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-certs\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.816940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816822    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-podinfo\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.816940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816846    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2878a8c6-f649-4597-a63f-4a166f80aedf-istiod-ca-cert\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.816940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816869    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-envoy\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.816940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816909    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7j7w\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-kube-api-access-c7j7w\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.817223 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.816956    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-token\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.817223 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.817138    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-credential-socket\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.817223 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.817204    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-data\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.817364 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.817299    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-certs\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.817479 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.817453    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-socket\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.817644 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.817626    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2878a8c6-f649-4597-a63f-4a166f80aedf-istiod-ca-cert\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.819081 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.819061    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-envoy\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.819402 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.819384    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-podinfo\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.832331 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.832299    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-token\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.832460 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.832401    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7j7w\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-kube-api-access-c7j7w\") pod \"e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") " pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:49.920688 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:49.920650    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:50.056451 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.056418    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"]
Jul 02 17:40:50.058897 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:40:50.058867    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2878a8c6_f649_4597_a63f_4a166f80aedf.slice/crio-b3ba92d62b39b77355f8647eccda9c78fc2228e1cbdc8d492020d70eeea7bd53 WatchSource:0}: Error finding container b3ba92d62b39b77355f8647eccda9c78fc2228e1cbdc8d492020d70eeea7bd53: Status 404 returned error can't find the container with id b3ba92d62b39b77355f8647eccda9c78fc2228e1cbdc8d492020d70eeea7bd53
Jul 02 17:40:50.061183 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.061152    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:40:50.061259 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.061218    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:40:50.061259 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.061247    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:40:50.256431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.256325    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt" event={"ID":"2878a8c6-f649-4597-a63f-4a166f80aedf","Type":"ContainerStarted","Data":"cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3"}
Jul 02 17:40:50.256431 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.256382    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt" event={"ID":"2878a8c6-f649-4597-a63f-4a166f80aedf","Type":"ContainerStarted","Data":"b3ba92d62b39b77355f8647eccda9c78fc2228e1cbdc8d492020d70eeea7bd53"}
Jul 02 17:40:50.276819 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.276754    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt" podStartSLOduration=1.276732163 podStartE2EDuration="1.276732163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:40:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:40:50.27415942 +0000 UTC m=+1805.265119673" watchObservedRunningTime="2026-07-02 17:40:50.276732163 +0000 UTC m=+1805.267692419"
Jul 02 17:40:50.799702 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.799667    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"]
Jul 02 17:40:50.802080 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.802059    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:50.804036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.804010    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-243563a0-serving-cert\""
Jul 02 17:40:50.813507 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.813479    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"]
Jul 02 17:40:50.921524 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.921487    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:50.927500 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.927473    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:50.927622 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.927507    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e57c3eb6-7787-4493-8dfd-1c9808b80879-openshift-service-ca\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:50.927622 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:50.927576    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc7zq\" (UniqueName: \"kubernetes.io/projected/e57c3eb6-7787-4493-8dfd-1c9808b80879-kube-api-access-bc7zq\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.028873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.028833    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.028873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.028871    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e57c3eb6-7787-4493-8dfd-1c9808b80879-openshift-service-ca\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.029087 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.028925    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc7zq\" (UniqueName: \"kubernetes.io/projected/e57c3eb6-7787-4493-8dfd-1c9808b80879-kube-api-access-bc7zq\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.029087 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:40:51.029015    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-243563a0-serving-cert: secret "maas-api-e2e-ait-243563a0-serving-cert" not found
Jul 02 17:40:51.029155 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:40:51.029138    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls podName:e57c3eb6-7787-4493-8dfd-1c9808b80879 nodeName:}" failed. No retries permitted until 2026-07-02 17:40:51.529117075 +0000 UTC m=+1806.520077325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls") pod "maas-api-e2e-ait-243563a0-598685d9b7-9g2sv" (UID: "e57c3eb6-7787-4493-8dfd-1c9808b80879") : secret "maas-api-e2e-ait-243563a0-serving-cert" not found
Jul 02 17:40:51.029562 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.029538    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e57c3eb6-7787-4493-8dfd-1c9808b80879-openshift-service-ca\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.036949 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.036920    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc7zq\" (UniqueName: \"kubernetes.io/projected/e57c3eb6-7787-4493-8dfd-1c9808b80879-kube-api-access-bc7zq\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.533989 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.533947    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.536568 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.536535    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls\") pod \"maas-api-e2e-ait-243563a0-598685d9b7-9g2sv\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") " pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.714502 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.714454    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:51.848333 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.848297    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"]
Jul 02 17:40:51.849211 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:40:51.849179    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57c3eb6_7787_4493_8dfd_1c9808b80879.slice/crio-e2593c330f1713dd2f09ab531a1538ac76e873a01fc043667cde2b35c192486b WatchSource:0}: Error finding container e2593c330f1713dd2f09ab531a1538ac76e873a01fc043667cde2b35c192486b: Status 404 returned error can't find the container with id e2593c330f1713dd2f09ab531a1538ac76e873a01fc043667cde2b35c192486b
Jul 02 17:40:51.926224 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:51.926185    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:52.267541 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:52.267502    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv" event={"ID":"e57c3eb6-7787-4493-8dfd-1c9808b80879","Type":"ContainerStarted","Data":"1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc"}
Jul 02 17:40:52.267743 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:52.267568    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv" event={"ID":"e57c3eb6-7787-4493-8dfd-1c9808b80879","Type":"ContainerStarted","Data":"e2593c330f1713dd2f09ab531a1538ac76e873a01fc043667cde2b35c192486b"}
Jul 02 17:40:52.267798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:52.267781    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:52.267839 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:52.267827    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:52.268652 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:52.268632    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:40:52.294497 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:52.294427    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv" podStartSLOduration=2.028412084 podStartE2EDuration="2.294409981s" totalImagesPullingTime="265.997897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:40:52.291945215 +0000 UTC m=+1807.282905480" watchObservedRunningTime="2026-07-02 17:40:52.294409981 +0000 UTC m=+1807.285370237"
Jul 02 17:40:56.186612 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.185932    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"]
Jul 02 17:40:56.186612 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.186261    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv" podUID="e57c3eb6-7787-4493-8dfd-1c9808b80879" containerName="maas-api" containerID="cri-o://1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc" gracePeriod=30
Jul 02 17:40:56.465277 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.465248    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:56.582447 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.582416    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls\") pod \"e57c3eb6-7787-4493-8dfd-1c9808b80879\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") "
Jul 02 17:40:56.582649 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.582490    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc7zq\" (UniqueName: \"kubernetes.io/projected/e57c3eb6-7787-4493-8dfd-1c9808b80879-kube-api-access-bc7zq\") pod \"e57c3eb6-7787-4493-8dfd-1c9808b80879\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") "
Jul 02 17:40:56.582649 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.582581    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e57c3eb6-7787-4493-8dfd-1c9808b80879-openshift-service-ca\") pod \"e57c3eb6-7787-4493-8dfd-1c9808b80879\" (UID: \"e57c3eb6-7787-4493-8dfd-1c9808b80879\") "
Jul 02 17:40:56.582946 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.582922    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57c3eb6-7787-4493-8dfd-1c9808b80879-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e57c3eb6-7787-4493-8dfd-1c9808b80879" (UID: "e57c3eb6-7787-4493-8dfd-1c9808b80879"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:40:56.584616 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.584577    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e57c3eb6-7787-4493-8dfd-1c9808b80879" (UID: "e57c3eb6-7787-4493-8dfd-1c9808b80879"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:40:56.584706 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.584676    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57c3eb6-7787-4493-8dfd-1c9808b80879-kube-api-access-bc7zq" (OuterVolumeSpecName: "kube-api-access-bc7zq") pod "e57c3eb6-7787-4493-8dfd-1c9808b80879" (UID: "e57c3eb6-7787-4493-8dfd-1c9808b80879"). InnerVolumeSpecName "kube-api-access-bc7zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:40:56.684112 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.684069    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc7zq\" (UniqueName: \"kubernetes.io/projected/e57c3eb6-7787-4493-8dfd-1c9808b80879-kube-api-access-bc7zq\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:56.684112 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.684102    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e57c3eb6-7787-4493-8dfd-1c9808b80879-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:56.684112 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:56.684113    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57c3eb6-7787-4493-8dfd-1c9808b80879-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:40:57.295800 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.295756    2550 generic.go:356] "Generic (PLEG): container finished" podID="e57c3eb6-7787-4493-8dfd-1c9808b80879" containerID="1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc" exitCode=0
Jul 02 17:40:57.296292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.295911    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv" event={"ID":"e57c3eb6-7787-4493-8dfd-1c9808b80879","Type":"ContainerDied","Data":"1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc"}
Jul 02 17:40:57.296292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.295966    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv" event={"ID":"e57c3eb6-7787-4493-8dfd-1c9808b80879","Type":"ContainerDied","Data":"e2593c330f1713dd2f09ab531a1538ac76e873a01fc043667cde2b35c192486b"}
Jul 02 17:40:57.296292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.295999    2550 scope.go:117] "RemoveContainer" containerID="1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc"
Jul 02 17:40:57.296292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.296186    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"
Jul 02 17:40:57.309331 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.309304    2550 scope.go:117] "RemoveContainer" containerID="1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc"
Jul 02 17:40:57.309924 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:40:57.309896    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc\": container with ID starting with 1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc not found: ID does not exist" containerID="1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc"
Jul 02 17:40:57.310104 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.310074    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc"} err="failed to get container status \"1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc\": rpc error: code = NotFound desc = could not find container \"1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc\": container with ID starting with 1c4bb7d8208332425599c8a01bd5f80b2c8189b593d83bfe04bd961e960941dc not found: ID does not exist"
Jul 02 17:40:57.330977 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.330944    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"]
Jul 02 17:40:57.334162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.334130    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-243563a0-598685d9b7-9g2sv"]
Jul 02 17:40:57.454121 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:40:57.454090    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57c3eb6-7787-4493-8dfd-1c9808b80879" path="/var/lib/kubelet/pods/e57c3eb6-7787-4493-8dfd-1c9808b80879/volumes"
Jul 02 17:41:01.928425 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:01.928376    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"]
Jul 02 17:41:01.928945 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:01.928650    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt" podUID="2878a8c6-f649-4597-a63f-4a166f80aedf" containerName="istio-proxy" containerID="cri-o://cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3" gracePeriod=30
Jul 02 17:41:02.067765 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.067738    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:41:02.243233 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243130    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2878a8c6-f649-4597-a63f-4a166f80aedf-istiod-ca-cert\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243233 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243180    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-envoy\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243233 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243197    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-credential-socket\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243233 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243214    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-data\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243567 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243278    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-certs\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243567 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243306    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-podinfo\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243567 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243353    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7j7w\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-kube-api-access-c7j7w\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243567 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243389    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-socket\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243567 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243445    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-token\") pod \"2878a8c6-f649-4597-a63f-4a166f80aedf\" (UID: \"2878a8c6-f649-4597-a63f-4a166f80aedf\") "
Jul 02 17:41:02.243567 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243530    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:02.243567 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243542    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:02.243923 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243669    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2878a8c6-f649-4597-a63f-4a166f80aedf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:41:02.243923 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243867    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:02.244022 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243927    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2878a8c6-f649-4597-a63f-4a166f80aedf-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.244022 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243948    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.244022 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.243968    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.244185 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.244155    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-data" (OuterVolumeSpecName: "istio-data") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:02.245658 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.245626    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-token" (OuterVolumeSpecName: "istio-token") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:41:02.245765 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.245692    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-kube-api-access-c7j7w" (OuterVolumeSpecName: "kube-api-access-c7j7w") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "kube-api-access-c7j7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:41:02.245765 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.245716    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:02.245765 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.245732    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2878a8c6-f649-4597-a63f-4a166f80aedf" (UID: "2878a8c6-f649-4597-a63f-4a166f80aedf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:41:02.326015 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.325970    2550 generic.go:356] "Generic (PLEG): container finished" podID="2878a8c6-f649-4597-a63f-4a166f80aedf" containerID="cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3" exitCode=0
Jul 02 17:41:02.326204 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.326027    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"
Jul 02 17:41:02.326204 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.326051    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt" event={"ID":"2878a8c6-f649-4597-a63f-4a166f80aedf","Type":"ContainerDied","Data":"cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3"}
Jul 02 17:41:02.326204 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.326105    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt" event={"ID":"2878a8c6-f649-4597-a63f-4a166f80aedf","Type":"ContainerDied","Data":"b3ba92d62b39b77355f8647eccda9c78fc2228e1cbdc8d492020d70eeea7bd53"}
Jul 02 17:41:02.326204 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.326162    2550 scope.go:117] "RemoveContainer" containerID="cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3"
Jul 02 17:41:02.340692 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.340661    2550 scope.go:117] "RemoveContainer" containerID="cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3"
Jul 02 17:41:02.341092 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:41:02.341069    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3\": container with ID starting with cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3 not found: ID does not exist" containerID="cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3"
Jul 02 17:41:02.341179 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.341099    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3"} err="failed to get container status \"cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3\": rpc error: code = NotFound desc = could not find container \"cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3\": container with ID starting with cee72cdc4e2f8072899311c20fbcf18f3da198b44ea264d5233bdb0a9755e1c3 not found: ID does not exist"
Jul 02 17:41:02.344539 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.344515    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7j7w\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-kube-api-access-c7j7w\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.344644 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.344543    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.344644 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.344558    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.344644 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.344570    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.344644 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.344583    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.344644 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.344620    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2878a8c6-f649-4597-a63f-4a166f80aedf-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:02.348769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.348740    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"]
Jul 02 17:41:02.352396 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:02.352370    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-243563a0-openshift-default-78b5bcf65f-w6qlt"]
Jul 02 17:41:03.455150 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:03.455115    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2878a8c6-f649-4597-a63f-4a166f80aedf" path="/var/lib/kubelet/pods/2878a8c6-f649-4597-a63f-4a166f80aedf/volumes"
Jul 02 17:41:08.154262 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.154221    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"]
Jul 02 17:41:08.154809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.154631    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2878a8c6-f649-4597-a63f-4a166f80aedf" containerName="istio-proxy"
Jul 02 17:41:08.154809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.154644    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2878a8c6-f649-4597-a63f-4a166f80aedf" containerName="istio-proxy"
Jul 02 17:41:08.154809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.154660    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57c3eb6-7787-4493-8dfd-1c9808b80879" containerName="maas-api"
Jul 02 17:41:08.154809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.154666    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57c3eb6-7787-4493-8dfd-1c9808b80879" containerName="maas-api"
Jul 02 17:41:08.154809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.154731    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="2878a8c6-f649-4597-a63f-4a166f80aedf" containerName="istio-proxy"
Jul 02 17:41:08.154809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.154738    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57c3eb6-7787-4493-8dfd-1c9808b80879" containerName="maas-api"
Jul 02 17:41:08.157573 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.157551    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.159772 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.159748    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a8fa56d3-openshift-default-dockercfg-5h7pw\""
Jul 02 17:41:08.173564 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.173535    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"]
Jul 02 17:41:08.298132 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298086    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-certs\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.298328 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298191    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-envoy\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.298328 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298224    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-token\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.298328 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298263    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-data\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.298328 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298280    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-socket\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.298328 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298326    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istiod-ca-cert\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.298498 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298356    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-credential-socket\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.298498 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298373    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml5z7\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-kube-api-access-ml5z7\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.298498 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.298400    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-podinfo\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399420 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399378    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-certs\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399662 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399434    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-envoy\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399662 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399452    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-token\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399662 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399483    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-data\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399662 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399502    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-socket\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399662 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399535    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istiod-ca-cert\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399662 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399573    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-credential-socket\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399662 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399633    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml5z7\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-kube-api-access-ml5z7\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399673    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-podinfo\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.399999 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.399955    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-certs\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.400099 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.400007    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-data\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.400099 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.400064    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-socket\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.400289 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.400269    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istiod-ca-cert\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.400338 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.400295    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-credential-socket\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.401952 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.401920    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-envoy\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.402101 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.402081    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-podinfo\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.407405 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.407348    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml5z7\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-kube-api-access-ml5z7\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.407778 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.407757    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-token\") pod \"e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") " pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.468926 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.468891    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:08.602051 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.601997    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"]
Jul 02 17:41:08.604571 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:41:08.604543    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ee1720_1de2_4d9f_b465_5bd4dba3ecae.slice/crio-e2a52edcb2076fd164f5e2642244ff9c509386bfbc7faede8b2f418afaae6ce9 WatchSource:0}: Error finding container e2a52edcb2076fd164f5e2642244ff9c509386bfbc7faede8b2f418afaae6ce9: Status 404 returned error can't find the container with id e2a52edcb2076fd164f5e2642244ff9c509386bfbc7faede8b2f418afaae6ce9
Jul 02 17:41:08.606810 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.606772    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:41:08.606908 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.606862    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:41:08.606963 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:08.606904    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:41:09.365553 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.365519    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w" event={"ID":"00ee1720-1de2-4d9f-b465-5bd4dba3ecae","Type":"ContainerStarted","Data":"9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7"}
Jul 02 17:41:09.365979 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.365571    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w" event={"ID":"00ee1720-1de2-4d9f-b465-5bd4dba3ecae","Type":"ContainerStarted","Data":"e2a52edcb2076fd164f5e2642244ff9c509386bfbc7faede8b2f418afaae6ce9"}
Jul 02 17:41:09.386828 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.386761    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w" podStartSLOduration=1.386742623 podStartE2EDuration="1.386742623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:41:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:41:09.384973516 +0000 UTC m=+1824.375933771" watchObservedRunningTime="2026-07-02 17:41:09.386742623 +0000 UTC m=+1824.377702926"
Jul 02 17:41:09.469275 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.469246    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:09.473917 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.473898    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:09.565397 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.565360    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"]
Jul 02 17:41:09.567844 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.567824    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:09.570610 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.570580    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-a8fa56d3-serving-cert\""
Jul 02 17:41:09.594262 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.594231    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"]
Jul 02 17:41:09.607356 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.607323    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-openshift-service-ca\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:09.607734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.607709    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:09.607844 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.607780    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghfqn\" (UniqueName: \"kubernetes.io/projected/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-kube-api-access-ghfqn\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:09.708654 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.708540    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-openshift-service-ca\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:09.708818 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.708671    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:09.708818 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.708693    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghfqn\" (UniqueName: \"kubernetes.io/projected/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-kube-api-access-ghfqn\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:09.708936 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:41:09.708822    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-a8fa56d3-serving-cert: secret "maas-api-e2e-derive-a8fa56d3-serving-cert" not found
Jul 02 17:41:09.708936 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:41:09.708896    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls podName:754a4f0e-fd08-49f7-a7f7-97f816e3aba7 nodeName:}" failed. No retries permitted until 2026-07-02 17:41:10.208873805 +0000 UTC m=+1825.199834037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls") pod "maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz" (UID: "754a4f0e-fd08-49f7-a7f7-97f816e3aba7") : secret "maas-api-e2e-derive-a8fa56d3-serving-cert" not found
Jul 02 17:41:09.709184 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.709164    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-openshift-service-ca\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:09.720635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:09.720580    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghfqn\" (UniqueName: \"kubernetes.io/projected/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-kube-api-access-ghfqn\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:10.214931 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:10.214871    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:10.218033 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:10.217997    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls\") pod \"maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") " pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:10.371916 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:10.371889    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:10.372982 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:10.372961    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:10.477827 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:10.477741    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:10.619717 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:10.619689    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"]
Jul 02 17:41:10.621807 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:41:10.621778    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754a4f0e_fd08_49f7_a7f7_97f816e3aba7.slice/crio-b22f99b515ba182d6ccf6bb4ea0fccea24c59e989901175c25022e33434a1cfa WatchSource:0}: Error finding container b22f99b515ba182d6ccf6bb4ea0fccea24c59e989901175c25022e33434a1cfa: Status 404 returned error can't find the container with id b22f99b515ba182d6ccf6bb4ea0fccea24c59e989901175c25022e33434a1cfa
Jul 02 17:41:11.379003 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:11.378965    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz" event={"ID":"754a4f0e-fd08-49f7-a7f7-97f816e3aba7","Type":"ContainerStarted","Data":"f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b"}
Jul 02 17:41:11.379460 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:11.379058    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:11.379460 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:11.379089    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz" event={"ID":"754a4f0e-fd08-49f7-a7f7-97f816e3aba7","Type":"ContainerStarted","Data":"b22f99b515ba182d6ccf6bb4ea0fccea24c59e989901175c25022e33434a1cfa"}
Jul 02 17:41:11.394338 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:11.394291    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz" podStartSLOduration=2.053537517 podStartE2EDuration="2.394273501s" totalImagesPullingTime="340.735984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:41:11.393094405 +0000 UTC m=+1826.384054660" watchObservedRunningTime="2026-07-02 17:41:11.394273501 +0000 UTC m=+1826.385233753"
Jul 02 17:41:13.879762 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:13.879723    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"]
Jul 02 17:41:13.880329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:13.879971    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w" podUID="00ee1720-1de2-4d9f-b465-5bd4dba3ecae" containerName="istio-proxy" containerID="cri-o://9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7" gracePeriod=30
Jul 02 17:41:14.002625 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.002261    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"]
Jul 02 17:41:14.002625 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.002486    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz" podUID="754a4f0e-fd08-49f7-a7f7-97f816e3aba7" containerName="maas-api" containerID="cri-o://f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b" gracePeriod=30
Jul 02 17:41:14.254379 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.254349    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:14.353203 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.353166    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls\") pod \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") "
Jul 02 17:41:14.353375 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.353231    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-openshift-service-ca\") pod \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") "
Jul 02 17:41:14.353375 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.353276    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghfqn\" (UniqueName: \"kubernetes.io/projected/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-kube-api-access-ghfqn\") pod \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\" (UID: \"754a4f0e-fd08-49f7-a7f7-97f816e3aba7\") "
Jul 02 17:41:14.353711 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.353685    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "754a4f0e-fd08-49f7-a7f7-97f816e3aba7" (UID: "754a4f0e-fd08-49f7-a7f7-97f816e3aba7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:41:14.355307 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.355283    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "754a4f0e-fd08-49f7-a7f7-97f816e3aba7" (UID: "754a4f0e-fd08-49f7-a7f7-97f816e3aba7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:41:14.355376 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.355326    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-kube-api-access-ghfqn" (OuterVolumeSpecName: "kube-api-access-ghfqn") pod "754a4f0e-fd08-49f7-a7f7-97f816e3aba7" (UID: "754a4f0e-fd08-49f7-a7f7-97f816e3aba7"). InnerVolumeSpecName "kube-api-access-ghfqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:41:14.393834 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.393798    2550 generic.go:356] "Generic (PLEG): container finished" podID="754a4f0e-fd08-49f7-a7f7-97f816e3aba7" containerID="f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b" exitCode=0
Jul 02 17:41:14.393995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.393845    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"
Jul 02 17:41:14.393995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.393852    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz" event={"ID":"754a4f0e-fd08-49f7-a7f7-97f816e3aba7","Type":"ContainerDied","Data":"f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b"}
Jul 02 17:41:14.393995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.393905    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz" event={"ID":"754a4f0e-fd08-49f7-a7f7-97f816e3aba7","Type":"ContainerDied","Data":"b22f99b515ba182d6ccf6bb4ea0fccea24c59e989901175c25022e33434a1cfa"}
Jul 02 17:41:14.393995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.393937    2550 scope.go:117] "RemoveContainer" containerID="f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b"
Jul 02 17:41:14.403222 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.403194    2550 scope.go:117] "RemoveContainer" containerID="f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b"
Jul 02 17:41:14.403488 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:41:14.403469    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b\": container with ID starting with f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b not found: ID does not exist" containerID="f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b"
Jul 02 17:41:14.403536 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.403499    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b"} err="failed to get container status \"f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b\": rpc error: code = NotFound desc = could not find container \"f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b\": container with ID starting with f31d8db0f049c92f1df1717f383866caf298d38a9738d22f31b936110183311b not found: ID does not exist"
Jul 02 17:41:14.413368 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.413336    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"]
Jul 02 17:41:14.416904 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.416880    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-a8fa56d3-fdd959d64-lhlhz"]
Jul 02 17:41:14.454801 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.454726    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:14.454801 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.454755    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:14.454801 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:14.454766    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghfqn\" (UniqueName: \"kubernetes.io/projected/754a4f0e-fd08-49f7-a7f7-97f816e3aba7-kube-api-access-ghfqn\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:15.454669 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:15.454628    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="754a4f0e-fd08-49f7-a7f7-97f816e3aba7" path="/var/lib/kubelet/pods/754a4f0e-fd08-49f7-a7f7-97f816e3aba7/volumes"
Jul 02 17:41:19.131395 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.131367    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:19.202056 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.201966    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-envoy\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202056 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202004    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istiod-ca-cert\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202056 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202033    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-token\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202056 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202056    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml5z7\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-kube-api-access-ml5z7\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202103    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-podinfo\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202192    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-certs\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202244    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-socket\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202319    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-data\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202367    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-credential-socket\") pod \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\" (UID: \"00ee1720-1de2-4d9f-b465-5bd4dba3ecae\") "
Jul 02 17:41:19.202738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202410    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:19.202738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202523    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:19.202738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202542    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:41:19.202738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202644    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-data" (OuterVolumeSpecName: "istio-data") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:19.202898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202759    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:19.202898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202794    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.202898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202806    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.202898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202815    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.202898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.202824    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.204310 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.204278    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:41:19.204471 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.204448    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:41:19.204801 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.204778    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-token" (OuterVolumeSpecName: "istio-token") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:41:19.204801 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.204789    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-kube-api-access-ml5z7" (OuterVolumeSpecName: "kube-api-access-ml5z7") pod "00ee1720-1de2-4d9f-b465-5bd4dba3ecae" (UID: "00ee1720-1de2-4d9f-b465-5bd4dba3ecae"). InnerVolumeSpecName "kube-api-access-ml5z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:41:19.303373 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.303338    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.303373 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.303370    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.303373 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.303379    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.303640 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.303389    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.303640 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.303398    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml5z7\" (UniqueName: \"kubernetes.io/projected/00ee1720-1de2-4d9f-b465-5bd4dba3ecae-kube-api-access-ml5z7\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:41:19.420354 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.420320    2550 generic.go:356] "Generic (PLEG): container finished" podID="00ee1720-1de2-4d9f-b465-5bd4dba3ecae" containerID="9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7" exitCode=0
Jul 02 17:41:19.420537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.420371    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"
Jul 02 17:41:19.420537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.420400    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w" event={"ID":"00ee1720-1de2-4d9f-b465-5bd4dba3ecae","Type":"ContainerDied","Data":"9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7"}
Jul 02 17:41:19.420537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.420451    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w" event={"ID":"00ee1720-1de2-4d9f-b465-5bd4dba3ecae","Type":"ContainerDied","Data":"e2a52edcb2076fd164f5e2642244ff9c509386bfbc7faede8b2f418afaae6ce9"}
Jul 02 17:41:19.420537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.420473    2550 scope.go:117] "RemoveContainer" containerID="9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7"
Jul 02 17:41:19.429918 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.429901    2550 scope.go:117] "RemoveContainer" containerID="9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7"
Jul 02 17:41:19.430173 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:41:19.430153    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7\": container with ID starting with 9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7 not found: ID does not exist" containerID="9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7"
Jul 02 17:41:19.430222 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.430180    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7"} err="failed to get container status \"9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7\": rpc error: code = NotFound desc = could not find container \"9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7\": container with ID starting with 9e1745a889ca05c86fe6cee08fb722c836db950cb133996cfb74a352195da5d7 not found: ID does not exist"
Jul 02 17:41:19.441206 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.441177    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"]
Jul 02 17:41:19.446454 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.446429    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a8fa56d3-openshift-default-bcf546c59-stk8w"]
Jul 02 17:41:19.454624 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:41:19.454554    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00ee1720-1de2-4d9f-b465-5bd4dba3ecae" path="/var/lib/kubelet/pods/00ee1720-1de2-4d9f-b465-5bd4dba3ecae/volumes"
Jul 02 17:43:01.597709 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.597671    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"]
Jul 02 17:43:01.598110 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.598064    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754a4f0e-fd08-49f7-a7f7-97f816e3aba7" containerName="maas-api"
Jul 02 17:43:01.598110 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.598076    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="754a4f0e-fd08-49f7-a7f7-97f816e3aba7" containerName="maas-api"
Jul 02 17:43:01.598110 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.598095    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ee1720-1de2-4d9f-b465-5bd4dba3ecae" containerName="istio-proxy"
Jul 02 17:43:01.598110 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.598103    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ee1720-1de2-4d9f-b465-5bd4dba3ecae" containerName="istio-proxy"
Jul 02 17:43:01.598249 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.598167    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="754a4f0e-fd08-49f7-a7f7-97f816e3aba7" containerName="maas-api"
Jul 02 17:43:01.598249 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.598180    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ee1720-1de2-4d9f-b465-5bd4dba3ecae" containerName="istio-proxy"
Jul 02 17:43:01.600079 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.600058    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.601822 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.601802    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-db691e8b-openshift-default-dockercfg-pth94\""
Jul 02 17:43:01.623882 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.623845    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"]
Jul 02 17:43:01.727682 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727643    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-data\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.727867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727703    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-istio-token\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.727867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727722    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-credential-socket\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.727867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727760    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-certs\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.727867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727784    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-envoy\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.727867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727804    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88a7a853-9297-4631-ade6-52be3d1a926c-istiod-ca-cert\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.727867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727828    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8f54\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-kube-api-access-c8f54\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.727867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727851    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-socket\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.728116 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.727872    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88a7a853-9297-4631-ade6-52be3d1a926c-istio-podinfo\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.828522 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828484    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-data\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.828743 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828544    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-istio-token\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.828743 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828672    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-credential-socket\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.828877 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828765    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-certs\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.828877 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828811    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-envoy\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.828877 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828835    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88a7a853-9297-4631-ade6-52be3d1a926c-istiod-ca-cert\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.828877 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828866    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8f54\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-kube-api-access-c8f54\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.829136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828909    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-socket\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.829136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828940    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88a7a853-9297-4631-ade6-52be3d1a926c-istio-podinfo\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.829136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.829073    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-credential-socket\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.829136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.829097    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-certs\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.829136 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.828909    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-data\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.829392 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.829234    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-socket\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.829510 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.829490    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88a7a853-9297-4631-ade6-52be3d1a926c-istiod-ca-cert\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.831153 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.831130    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-envoy\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.831494 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.831468    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88a7a853-9297-4631-ade6-52be3d1a926c-istio-podinfo\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.836541 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.836510    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8f54\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-kube-api-access-c8f54\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.836899 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.836879    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-istio-token\") pod \"e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") " pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:01.910967 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:01.910927    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:02.047634 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:02.047576    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"]
Jul 02 17:43:02.049930 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:43:02.049906    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a7a853_9297_4631_ade6_52be3d1a926c.slice/crio-7014a9ab32ed01b3f1f4fbc93ba9c99d48f8f55d63f20bc8eb3d9af36ad63b2e WatchSource:0}: Error finding container 7014a9ab32ed01b3f1f4fbc93ba9c99d48f8f55d63f20bc8eb3d9af36ad63b2e: Status 404 returned error can't find the container with id 7014a9ab32ed01b3f1f4fbc93ba9c99d48f8f55d63f20bc8eb3d9af36ad63b2e
Jul 02 17:43:02.052526 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:02.052495    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:02.052620 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:02.052567    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:02.052620 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:02.052613    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:02.889313 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:02.889278    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" event={"ID":"88a7a853-9297-4631-ade6-52be3d1a926c","Type":"ContainerStarted","Data":"b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7"}
Jul 02 17:43:02.889834 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:02.889327    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" event={"ID":"88a7a853-9297-4631-ade6-52be3d1a926c","Type":"ContainerStarted","Data":"7014a9ab32ed01b3f1f4fbc93ba9c99d48f8f55d63f20bc8eb3d9af36ad63b2e"}
Jul 02 17:43:02.909340 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:02.909286    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" podStartSLOduration=1.9092681649999999 podStartE2EDuration="1.909268165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:43:02.906257982 +0000 UTC m=+1937.897218236" watchObservedRunningTime="2026-07-02 17:43:02.909268165 +0000 UTC m=+1937.900228419"
Jul 02 17:43:02.912001 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:02.911972    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:03.915928 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:03.915895    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:04.864121 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.864077    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"]
Jul 02 17:43:04.866508 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.866489    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:04.868401 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.868382    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-db691e8b-serving-cert\""
Jul 02 17:43:04.875036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.875006    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"]
Jul 02 17:43:04.898583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.898542    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:04.899562 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.899538    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:04.959789 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.959754    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:04.960190 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.959873    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-openshift-service-ca\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:04.960190 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:04.960006    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llmdv\" (UniqueName: \"kubernetes.io/projected/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-kube-api-access-llmdv\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.060901 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.060867    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llmdv\" (UniqueName: \"kubernetes.io/projected/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-kube-api-access-llmdv\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.061075 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.060925    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.061075 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.060953    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-openshift-service-ca\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.061173 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:43:05.061070    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-db691e8b-serving-cert: secret "maas-api-e2e-mt-db691e8b-serving-cert" not found
Jul 02 17:43:05.061173 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:43:05.061140    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls podName:497c8a31-6b2b-480e-b457-0acb3b2e1b6b nodeName:}" failed. No retries permitted until 2026-07-02 17:43:05.561124793 +0000 UTC m=+1940.552085025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls") pod "maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs" (UID: "497c8a31-6b2b-480e-b457-0acb3b2e1b6b") : secret "maas-api-e2e-mt-db691e8b-serving-cert" not found
Jul 02 17:43:05.061623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.061585    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-openshift-service-ca\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.071341 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.071320    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llmdv\" (UniqueName: \"kubernetes.io/projected/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-kube-api-access-llmdv\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.566221 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.566164    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.568557 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.568533    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls\") pod \"maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") " pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.780728 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.780696    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:05.932310 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:05.932281    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"]
Jul 02 17:43:05.935083 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:43:05.935037    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497c8a31_6b2b_480e_b457_0acb3b2e1b6b.slice/crio-a8c9fcebf2f7f13f9deed4213325bf1057f26ce6e29e52a560fb590055b3e7e2 WatchSource:0}: Error finding container a8c9fcebf2f7f13f9deed4213325bf1057f26ce6e29e52a560fb590055b3e7e2: Status 404 returned error can't find the container with id a8c9fcebf2f7f13f9deed4213325bf1057f26ce6e29e52a560fb590055b3e7e2
Jul 02 17:43:06.909692 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:06.909650    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs" event={"ID":"497c8a31-6b2b-480e-b457-0acb3b2e1b6b","Type":"ContainerStarted","Data":"67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404"}
Jul 02 17:43:06.910085 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:06.909715    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs" event={"ID":"497c8a31-6b2b-480e-b457-0acb3b2e1b6b","Type":"ContainerStarted","Data":"a8c9fcebf2f7f13f9deed4213325bf1057f26ce6e29e52a560fb590055b3e7e2"}
Jul 02 17:43:06.926796 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:06.926746    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs" podStartSLOduration=2.5121504359999998 podStartE2EDuration="2.926730365s" totalImagesPullingTime="414.579929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:43:06.925368715 +0000 UTC m=+1941.916328972" watchObservedRunningTime="2026-07-02 17:43:06.926730365 +0000 UTC m=+1941.917690619"
Jul 02 17:43:07.913817 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:07.913782    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:13.923455 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:13.923424    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:16.917735 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:16.917700    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"]
Jul 02 17:43:16.918368 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:16.917945    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs" podUID="497c8a31-6b2b-480e-b457-0acb3b2e1b6b" containerName="maas-api" containerID="cri-o://67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404" gracePeriod=30
Jul 02 17:43:17.175921 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.175855    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:17.278891 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.278861    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llmdv\" (UniqueName: \"kubernetes.io/projected/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-kube-api-access-llmdv\") pod \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") "
Jul 02 17:43:17.279078 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.278902    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls\") pod \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") "
Jul 02 17:43:17.279078 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.278939    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-openshift-service-ca\") pod \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\" (UID: \"497c8a31-6b2b-480e-b457-0acb3b2e1b6b\") "
Jul 02 17:43:17.279463 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.279416    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "497c8a31-6b2b-480e-b457-0acb3b2e1b6b" (UID: "497c8a31-6b2b-480e-b457-0acb3b2e1b6b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:43:17.281164 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.281135    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "497c8a31-6b2b-480e-b457-0acb3b2e1b6b" (UID: "497c8a31-6b2b-480e-b457-0acb3b2e1b6b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:43:17.281261 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.281155    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-kube-api-access-llmdv" (OuterVolumeSpecName: "kube-api-access-llmdv") pod "497c8a31-6b2b-480e-b457-0acb3b2e1b6b" (UID: "497c8a31-6b2b-480e-b457-0acb3b2e1b6b"). InnerVolumeSpecName "kube-api-access-llmdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:43:17.379962 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.379919    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llmdv\" (UniqueName: \"kubernetes.io/projected/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-kube-api-access-llmdv\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:17.379962 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.379955    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:17.379962 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.379964    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/497c8a31-6b2b-480e-b457-0acb3b2e1b6b-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:17.963635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.963601    2550 generic.go:356] "Generic (PLEG): container finished" podID="497c8a31-6b2b-480e-b457-0acb3b2e1b6b" containerID="67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404" exitCode=0
Jul 02 17:43:17.964162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.963652    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"
Jul 02 17:43:17.964162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.963687    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs" event={"ID":"497c8a31-6b2b-480e-b457-0acb3b2e1b6b","Type":"ContainerDied","Data":"67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404"}
Jul 02 17:43:17.964162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.963756    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs" event={"ID":"497c8a31-6b2b-480e-b457-0acb3b2e1b6b","Type":"ContainerDied","Data":"a8c9fcebf2f7f13f9deed4213325bf1057f26ce6e29e52a560fb590055b3e7e2"}
Jul 02 17:43:17.964162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.963793    2550 scope.go:117] "RemoveContainer" containerID="67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404"
Jul 02 17:43:17.965537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.965506    2550 generic.go:356] "Generic (PLEG): container finished" podID="88a7a853-9297-4631-ade6-52be3d1a926c" containerID="b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7" exitCode=0
Jul 02 17:43:17.965648 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.965538    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" event={"ID":"88a7a853-9297-4631-ade6-52be3d1a926c","Type":"ContainerDied","Data":"b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7"}
Jul 02 17:43:17.966068 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.966029    2550 scope.go:117] "RemoveContainer" containerID="b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7"
Jul 02 17:43:17.967141 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.967110    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:17.967229 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.967188    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:17.967297 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.967228    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:17.972701 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.972676    2550 scope.go:117] "RemoveContainer" containerID="67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404"
Jul 02 17:43:17.972975 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:43:17.972954    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404\": container with ID starting with 67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404 not found: ID does not exist" containerID="67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404"
Jul 02 17:43:17.973033 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:17.972977    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404"} err="failed to get container status \"67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404\": rpc error: code = NotFound desc = could not find container \"67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404\": container with ID starting with 67f5818691949d31ae3d78229c38d2c2463f7b840ff22fd675184dc38590e404 not found: ID does not exist"
Jul 02 17:43:18.004492 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:18.004458    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"]
Jul 02 17:43:18.010813 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:18.010785    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-db691e8b-df64cd66f-lmtzs"]
Jul 02 17:43:18.973181 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:18.973144    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" event={"ID":"88a7a853-9297-4631-ade6-52be3d1a926c","Type":"ContainerStarted","Data":"604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24"}
Jul 02 17:43:19.461872 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:19.461840    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497c8a31-6b2b-480e-b457-0acb3b2e1b6b" path="/var/lib/kubelet/pods/497c8a31-6b2b-480e-b457-0acb3b2e1b6b/volumes"
Jul 02 17:43:19.899155 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:19.899119    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:19.911241 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:19.911196    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:19.912494 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:19.912456    2550 patch_prober.go:28] interesting pod/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 17:43:19.912649 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:19.912523    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 17:43:20.912066 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:20.912018    2550 patch_prober.go:28] interesting pod/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 17:43:20.912579 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:20.912090    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 17:43:21.911868 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:21.911820    2550 patch_prober.go:28] interesting pod/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 02 17:43:21.912083 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:21.911894    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 02 17:43:22.916325 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:22.916293    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:22.917504 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:22.917486    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:23.023925 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:23.023891    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"]
Jul 02 17:43:23.998703 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:23.998653    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy" containerID="cri-o://604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24" gracePeriod=30
Jul 02 17:43:29.258448 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.258422    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:29.295841 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.295761    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-istio-token\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.295841 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.295800    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8f54\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-kube-api-access-c8f54\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.295841 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.295819    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88a7a853-9297-4631-ade6-52be3d1a926c-istio-podinfo\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.296142 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.295945    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-envoy\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.296142 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.295997    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-data\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.296142 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.296055    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-credential-socket\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.296142 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.296086    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88a7a853-9297-4631-ade6-52be3d1a926c-istiod-ca-cert\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.296142 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.296123    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-certs\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.296393 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.296177    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-socket\") pod \"88a7a853-9297-4631-ade6-52be3d1a926c\" (UID: \"88a7a853-9297-4631-ade6-52be3d1a926c\") "
Jul 02 17:43:29.296573 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.296510    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:43:29.296573 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.296538    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88a7a853-9297-4631-ade6-52be3d1a926c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:43:29.296726 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.296668    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:43:29.296867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.296830    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:43:29.297261 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.297238    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-data" (OuterVolumeSpecName: "istio-data") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:43:29.298155 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.298126    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-istio-token" (OuterVolumeSpecName: "istio-token") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:43:29.298623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.298579    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:43:29.298684 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.298630    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88a7a853-9297-4631-ade6-52be3d1a926c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:43:29.298684 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.298650    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-kube-api-access-c8f54" (OuterVolumeSpecName: "kube-api-access-c8f54") pod "88a7a853-9297-4631-ade6-52be3d1a926c" (UID: "88a7a853-9297-4631-ade6-52be3d1a926c"). InnerVolumeSpecName "kube-api-access-c8f54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:43:29.397101 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397065    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:29.397101 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397096    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:29.397101 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397106    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88a7a853-9297-4631-ade6-52be3d1a926c-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:29.397326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397116    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:29.397326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397125    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:29.397326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397133    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:29.397326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397141    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8f54\" (UniqueName: \"kubernetes.io/projected/88a7a853-9297-4631-ade6-52be3d1a926c-kube-api-access-c8f54\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:29.397326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397149    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88a7a853-9297-4631-ade6-52be3d1a926c-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:29.397326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:29.397157    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88a7a853-9297-4631-ade6-52be3d1a926c-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:43:30.028987 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.028946    2550 generic.go:356] "Generic (PLEG): container finished" podID="88a7a853-9297-4631-ade6-52be3d1a926c" containerID="604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24" exitCode=0
Jul 02 17:43:30.029156 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.029003    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"
Jul 02 17:43:30.029156 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.029037    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" event={"ID":"88a7a853-9297-4631-ade6-52be3d1a926c","Type":"ContainerDied","Data":"604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24"}
Jul 02 17:43:30.029156 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.029092    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4" event={"ID":"88a7a853-9297-4631-ade6-52be3d1a926c","Type":"ContainerDied","Data":"7014a9ab32ed01b3f1f4fbc93ba9c99d48f8f55d63f20bc8eb3d9af36ad63b2e"}
Jul 02 17:43:30.029156 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.029114    2550 scope.go:117] "RemoveContainer" containerID="604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24"
Jul 02 17:43:30.039226 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.039209    2550 scope.go:117] "RemoveContainer" containerID="b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7"
Jul 02 17:43:30.045607 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.045549    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"]
Jul 02 17:43:30.047604 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.047573    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-db691e8b-openshift-default-7dfb796cf5-5gdr4"]
Jul 02 17:43:30.048665 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.048650    2550 scope.go:117] "RemoveContainer" containerID="604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24"
Jul 02 17:43:30.048950 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:43:30.048933    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24\": container with ID starting with 604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24 not found: ID does not exist" containerID="604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24"
Jul 02 17:43:30.049014 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.048957    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24"} err="failed to get container status \"604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24\": rpc error: code = NotFound desc = could not find container \"604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24\": container with ID starting with 604fd9e75becbd545a47c9d6226b0457c0532ddb2d975441afab598e73c64b24 not found: ID does not exist"
Jul 02 17:43:30.049014 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.048975    2550 scope.go:117] "RemoveContainer" containerID="b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7"
Jul 02 17:43:30.049194 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:43:30.049178    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7\": container with ID starting with b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7 not found: ID does not exist" containerID="b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7"
Jul 02 17:43:30.049235 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:30.049201    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7"} err="failed to get container status \"b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7\": rpc error: code = NotFound desc = could not find container \"b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7\": container with ID starting with b848ca297c3d1d3b784fd84d67dd937bfe91d353d6aa2abadb763ee256b46ff7 not found: ID does not exist"
Jul 02 17:43:31.454070 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:31.454037    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" path="/var/lib/kubelet/pods/88a7a853-9297-4631-ade6-52be3d1a926c/volumes"
Jul 02 17:43:42.148577 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.148499    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"]
Jul 02 17:43:42.148995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.148916    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy"
Jul 02 17:43:42.148995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.148929    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy"
Jul 02 17:43:42.148995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.148942    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy"
Jul 02 17:43:42.148995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.148948    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy"
Jul 02 17:43:42.148995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.148955    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497c8a31-6b2b-480e-b457-0acb3b2e1b6b" containerName="maas-api"
Jul 02 17:43:42.148995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.148962    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="497c8a31-6b2b-480e-b457-0acb3b2e1b6b" containerName="maas-api"
Jul 02 17:43:42.149179 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.149018    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy"
Jul 02 17:43:42.149179 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.149028    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a7a853-9297-4631-ade6-52be3d1a926c" containerName="istio-proxy"
Jul 02 17:43:42.149179 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.149036    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="497c8a31-6b2b-480e-b457-0acb3b2e1b6b" containerName="maas-api"
Jul 02 17:43:42.152171 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.152152    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.154313 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.154290    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6002673f-openshift-default-dockercfg-2vrzv\""
Jul 02 17:43:42.163169 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.163145    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"]
Jul 02 17:43:42.217299 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217266    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r8r9\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-kube-api-access-9r8r9\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.217478 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217313    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-certs\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.217478 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217346    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-socket\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.217478 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217369    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-data\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.217478 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217438    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763c47b8-7938-4050-ab0d-586b1374886c-istiod-ca-cert\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.217646 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217490    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-envoy\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.217646 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217559    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-credential-socket\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.217709 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217636    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-istio-token\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.217709 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.217678    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763c47b8-7938-4050-ab0d-586b1374886c-istio-podinfo\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.318639 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.318577    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r8r9\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-kube-api-access-9r8r9\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.318820 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.318751    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-certs\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.318820 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.318810    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-socket\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.318890 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.318831    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-data\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.318890 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.318851    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763c47b8-7938-4050-ab0d-586b1374886c-istiod-ca-cert\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.318890 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.318880    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-envoy\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.319369 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.319032    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-credential-socket\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.319369 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.319075    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-istio-token\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.319369 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.319110    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763c47b8-7938-4050-ab0d-586b1374886c-istio-podinfo\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.319369 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.319167    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-certs\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.319369 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.319298    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-socket\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.319369 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.319315    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-data\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.319660 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.319516    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-credential-socket\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.319660 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.319569    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763c47b8-7938-4050-ab0d-586b1374886c-istiod-ca-cert\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.321232 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.321205    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-envoy\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.321465 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.321445    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763c47b8-7938-4050-ab0d-586b1374886c-istio-podinfo\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.325495 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.325475    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-istio-token\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.325678 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.325662    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r8r9\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-kube-api-access-9r8r9\") pod \"e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") " pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.463395 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.463298    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:42.600583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.600551    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"]
Jul 02 17:43:42.602529 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:43:42.602494    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763c47b8_7938_4050_ab0d_586b1374886c.slice/crio-a4e604caf06e1579e5a206d2d9761e0ad36e2c80c67ca289e8609a122e278d90 WatchSource:0}: Error finding container a4e604caf06e1579e5a206d2d9761e0ad36e2c80c67ca289e8609a122e278d90: Status 404 returned error can't find the container with id a4e604caf06e1579e5a206d2d9761e0ad36e2c80c67ca289e8609a122e278d90
Jul 02 17:43:42.604908 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.604872    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:42.605003 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.604939    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:42.605003 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:42.604970    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:43.090103 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:43.090061    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" event={"ID":"763c47b8-7938-4050-ab0d-586b1374886c","Type":"ContainerStarted","Data":"13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af"}
Jul 02 17:43:43.090275 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:43.090115    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" event={"ID":"763c47b8-7938-4050-ab0d-586b1374886c","Type":"ContainerStarted","Data":"a4e604caf06e1579e5a206d2d9761e0ad36e2c80c67ca289e8609a122e278d90"}
Jul 02 17:43:43.107791 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:43.107731    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" podStartSLOduration=1.107710516 podStartE2EDuration="1.107710516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:43:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:43:43.107032337 +0000 UTC m=+1978.097992620" watchObservedRunningTime="2026-07-02 17:43:43.107710516 +0000 UTC m=+1978.098670772"
Jul 02 17:43:43.464036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:43.464002    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:43.468845 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:43.468820    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:44.094990 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:44.094954    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:44.095946 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:44.095926    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:45.100262 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.100221    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"]
Jul 02 17:43:45.111731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.111696    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.114415 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.114396    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-6002673f-serving-cert\""
Jul 02 17:43:45.119378 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.119353    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"]
Jul 02 17:43:45.245497 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.245459    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cbfd8d2-f158-4359-adb7-7f13d85077c3-openshift-service-ca\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.245717 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.245537    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gc8f\" (UniqueName: \"kubernetes.io/projected/3cbfd8d2-f158-4359-adb7-7f13d85077c3-kube-api-access-8gc8f\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.245717 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.245564    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.347166 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.347122    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cbfd8d2-f158-4359-adb7-7f13d85077c3-openshift-service-ca\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.347166 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.347175    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gc8f\" (UniqueName: \"kubernetes.io/projected/3cbfd8d2-f158-4359-adb7-7f13d85077c3-kube-api-access-8gc8f\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.347433 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.347198    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.347433 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:43:45.347320    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-6002673f-serving-cert: secret "maas-api-e2e-mt-6002673f-serving-cert" not found
Jul 02 17:43:45.347433 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:43:45.347399    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls podName:3cbfd8d2-f158-4359-adb7-7f13d85077c3 nodeName:}" failed. No retries permitted until 2026-07-02 17:43:45.847379373 +0000 UTC m=+1980.838339613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls") pod "maas-api-e2e-mt-6002673f-8945586d6-lxgfr" (UID: "3cbfd8d2-f158-4359-adb7-7f13d85077c3") : secret "maas-api-e2e-mt-6002673f-serving-cert" not found
Jul 02 17:43:45.347958 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.347931    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cbfd8d2-f158-4359-adb7-7f13d85077c3-openshift-service-ca\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.355224 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.355163    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gc8f\" (UniqueName: \"kubernetes.io/projected/3cbfd8d2-f158-4359-adb7-7f13d85077c3-kube-api-access-8gc8f\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.851846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.851807    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:45.854303 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:45.854266    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls\") pod \"maas-api-e2e-mt-6002673f-8945586d6-lxgfr\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") " pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:46.024101 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:46.024011    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:46.163499 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:46.163472    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"]
Jul 02 17:43:46.165632 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:43:46.165583    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbfd8d2_f158_4359_adb7_7f13d85077c3.slice/crio-22f16ec7ea309898f4caec99ecfab3123f5720be2146f7b4b5356b5827512230 WatchSource:0}: Error finding container 22f16ec7ea309898f4caec99ecfab3123f5720be2146f7b4b5356b5827512230: Status 404 returned error can't find the container with id 22f16ec7ea309898f4caec99ecfab3123f5720be2146f7b4b5356b5827512230
Jul 02 17:43:47.115165 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:47.115124    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr" event={"ID":"3cbfd8d2-f158-4359-adb7-7f13d85077c3","Type":"ContainerStarted","Data":"d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38"}
Jul 02 17:43:47.115378 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:47.115178    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr" event={"ID":"3cbfd8d2-f158-4359-adb7-7f13d85077c3","Type":"ContainerStarted","Data":"22f16ec7ea309898f4caec99ecfab3123f5720be2146f7b4b5356b5827512230"}
Jul 02 17:43:47.115378 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:47.115241    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:47.130583 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:47.130518    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr" podStartSLOduration=1.796522658 podStartE2EDuration="2.1304935s" totalImagesPullingTime="333.970842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:43:47.129495684 +0000 UTC m=+1982.120455935" watchObservedRunningTime="2026-07-02 17:43:47.1304935 +0000 UTC m=+1982.121453756"
Jul 02 17:43:53.125436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:53.125402    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:43:56.160969 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:56.160936    2550 generic.go:356] "Generic (PLEG): container finished" podID="763c47b8-7938-4050-ab0d-586b1374886c" containerID="13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af" exitCode=0
Jul 02 17:43:56.161385 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:56.161011    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" event={"ID":"763c47b8-7938-4050-ab0d-586b1374886c","Type":"ContainerDied","Data":"13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af"}
Jul 02 17:43:56.161433 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:56.161410    2550 scope.go:117] "RemoveContainer" containerID="13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af"
Jul 02 17:43:56.162539 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:56.162510    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:56.162655 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:56.162575    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:56.162655 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:56.162622    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:43:57.168295 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:57.168261    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" event={"ID":"763c47b8-7938-4050-ab0d-586b1374886c","Type":"ContainerStarted","Data":"00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623"}
Jul 02 17:43:57.463859 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:57.463764    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:57.465020 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:57.464997    2550 patch_prober.go:28] interesting pod/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 02 17:43:57.465106 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:57.465048    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 02 17:43:58.464504 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:58.464469    2550 patch_prober.go:28] interesting pod/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 02 17:43:58.464906 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:58.464532    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 02 17:43:59.095804 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:59.095753    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:43:59.463851 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:59.463817    2550 patch_prober.go:28] interesting pod/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 02 17:43:59.464130 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:43:59.464101    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 02 17:44:00.464226 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:00.464190    2550 patch_prober.go:28] interesting pod/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 02 17:44:00.464667 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:00.464245    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 02 17:44:01.467455 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:01.467430    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:44:01.468416 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:01.468395    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:44:22.348977 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.348938    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"]
Jul 02 17:44:22.349375 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.349227    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr" podUID="3cbfd8d2-f158-4359-adb7-7f13d85077c3" containerName="maas-api" containerID="cri-o://d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38" gracePeriod=30
Jul 02 17:44:22.594180 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.594151    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:44:22.704963 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.704929    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cbfd8d2-f158-4359-adb7-7f13d85077c3-openshift-service-ca\") pod \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") "
Jul 02 17:44:22.705135 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.705036    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls\") pod \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") "
Jul 02 17:44:22.705135 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.705062    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gc8f\" (UniqueName: \"kubernetes.io/projected/3cbfd8d2-f158-4359-adb7-7f13d85077c3-kube-api-access-8gc8f\") pod \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\" (UID: \"3cbfd8d2-f158-4359-adb7-7f13d85077c3\") "
Jul 02 17:44:22.705346 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.705317    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cbfd8d2-f158-4359-adb7-7f13d85077c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3cbfd8d2-f158-4359-adb7-7f13d85077c3" (UID: "3cbfd8d2-f158-4359-adb7-7f13d85077c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:44:22.707226 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.707196    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3cbfd8d2-f158-4359-adb7-7f13d85077c3" (UID: "3cbfd8d2-f158-4359-adb7-7f13d85077c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:44:22.707226 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.707207    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cbfd8d2-f158-4359-adb7-7f13d85077c3-kube-api-access-8gc8f" (OuterVolumeSpecName: "kube-api-access-8gc8f") pod "3cbfd8d2-f158-4359-adb7-7f13d85077c3" (UID: "3cbfd8d2-f158-4359-adb7-7f13d85077c3"). InnerVolumeSpecName "kube-api-access-8gc8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:44:22.806036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.805997    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3cbfd8d2-f158-4359-adb7-7f13d85077c3-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:44:22.806036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.806031    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3cbfd8d2-f158-4359-adb7-7f13d85077c3-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:44:22.806036 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:22.806040    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gc8f\" (UniqueName: \"kubernetes.io/projected/3cbfd8d2-f158-4359-adb7-7f13d85077c3-kube-api-access-8gc8f\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:44:23.295811 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.295774    2550 generic.go:356] "Generic (PLEG): container finished" podID="3cbfd8d2-f158-4359-adb7-7f13d85077c3" containerID="d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38" exitCode=0
Jul 02 17:44:23.296001 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.295827    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"
Jul 02 17:44:23.296001 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.295861    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr" event={"ID":"3cbfd8d2-f158-4359-adb7-7f13d85077c3","Type":"ContainerDied","Data":"d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38"}
Jul 02 17:44:23.296001 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.295915    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr" event={"ID":"3cbfd8d2-f158-4359-adb7-7f13d85077c3","Type":"ContainerDied","Data":"22f16ec7ea309898f4caec99ecfab3123f5720be2146f7b4b5356b5827512230"}
Jul 02 17:44:23.296001 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.295939    2550 scope.go:117] "RemoveContainer" containerID="d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38"
Jul 02 17:44:23.304911 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.304891    2550 scope.go:117] "RemoveContainer" containerID="d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38"
Jul 02 17:44:23.305173 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:44:23.305155    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38\": container with ID starting with d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38 not found: ID does not exist" containerID="d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38"
Jul 02 17:44:23.305229 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.305185    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38"} err="failed to get container status \"d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38\": rpc error: code = NotFound desc = could not find container \"d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38\": container with ID starting with d5724e2719bc3ad1a33312da61d73e44981d6bf57eb4dcd860cb1c88dc73bc38 not found: ID does not exist"
Jul 02 17:44:23.315252 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.315229    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"]
Jul 02 17:44:23.319042 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.319021    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-6002673f-8945586d6-lxgfr"]
Jul 02 17:44:23.454977 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:44:23.454942    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cbfd8d2-f158-4359-adb7-7f13d85077c3" path="/var/lib/kubelet/pods/3cbfd8d2-f158-4359-adb7-7f13d85077c3/volumes"
Jul 02 17:45:15.900179 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:15.900094    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"]
Jul 02 17:45:15.900774 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:15.900359    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy" containerID="cri-o://00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623" gracePeriod=30
Jul 02 17:45:16.469984 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:16.469949    2550 patch_prober.go:28] interesting pod/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 17:45:16.470154 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:16.470011    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:45:21.161460 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.161396    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:45:21.232167 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232130    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r8r9\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-kube-api-access-9r8r9\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232167 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232173    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-certs\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232403 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232202    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-istio-token\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232403 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232276    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-envoy\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232403 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232316    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-data\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232403 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232366    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-socket\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232418    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763c47b8-7938-4050-ab0d-586b1374886c-istiod-ca-cert\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232449    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-credential-socket\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232482    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:45:21.232635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232488    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763c47b8-7938-4050-ab0d-586b1374886c-istio-podinfo\") pod \"763c47b8-7938-4050-ab0d-586b1374886c\" (UID: \"763c47b8-7938-4050-ab0d-586b1374886c\") "
Jul 02 17:45:21.232927 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232719    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:45:21.232995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232871    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/763c47b8-7938-4050-ab0d-586b1374886c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:45:21.232995 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232962    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:45:21.233064 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.232901    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.233064 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.233019    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.233430 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.233395    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-data" (OuterVolumeSpecName: "istio-data") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:45:21.234636 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.234608    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-istio-token" (OuterVolumeSpecName: "istio-token") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:45:21.234636 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.234617    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/763c47b8-7938-4050-ab0d-586b1374886c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:45:21.234775 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.234708    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:45:21.234863 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.234847    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-kube-api-access-9r8r9" (OuterVolumeSpecName: "kube-api-access-9r8r9") pod "763c47b8-7938-4050-ab0d-586b1374886c" (UID: "763c47b8-7938-4050-ab0d-586b1374886c"). InnerVolumeSpecName "kube-api-access-9r8r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:45:21.334028 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.333989    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763c47b8-7938-4050-ab0d-586b1374886c-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.334028 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.334020    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.334028 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.334030    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763c47b8-7938-4050-ab0d-586b1374886c-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.334277 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.334041    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r8r9\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-kube-api-access-9r8r9\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.334277 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.334055    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763c47b8-7938-4050-ab0d-586b1374886c-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.334277 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.334067    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.334277 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.334074    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763c47b8-7938-4050-ab0d-586b1374886c-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:45:21.578720 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.578687    2550 generic.go:356] "Generic (PLEG): container finished" podID="763c47b8-7938-4050-ab0d-586b1374886c" containerID="00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623" exitCode=0
Jul 02 17:45:21.578980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.578749    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" event={"ID":"763c47b8-7938-4050-ab0d-586b1374886c","Type":"ContainerDied","Data":"00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623"}
Jul 02 17:45:21.578980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.578756    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"
Jul 02 17:45:21.578980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.578795    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm" event={"ID":"763c47b8-7938-4050-ab0d-586b1374886c","Type":"ContainerDied","Data":"a4e604caf06e1579e5a206d2d9761e0ad36e2c80c67ca289e8609a122e278d90"}
Jul 02 17:45:21.578980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.578817    2550 scope.go:117] "RemoveContainer" containerID="00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623"
Jul 02 17:45:21.587663 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.587642    2550 scope.go:117] "RemoveContainer" containerID="13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af"
Jul 02 17:45:21.594488 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.594463    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"]
Jul 02 17:45:21.597135 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.597117    2550 scope.go:117] "RemoveContainer" containerID="00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623"
Jul 02 17:45:21.597433 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:45:21.597413    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623\": container with ID starting with 00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623 not found: ID does not exist" containerID="00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623"
Jul 02 17:45:21.597496 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.597447    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623"} err="failed to get container status \"00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623\": rpc error: code = NotFound desc = could not find container \"00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623\": container with ID starting with 00e6b2dd1b7637420a917d15abfb54a5be94eaf0d612040a0c9467cb8c4ad623 not found: ID does not exist"
Jul 02 17:45:21.597496 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.597468    2550 scope.go:117] "RemoveContainer" containerID="13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af"
Jul 02 17:45:21.597733 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:45:21.597714    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af\": container with ID starting with 13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af not found: ID does not exist" containerID="13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af"
Jul 02 17:45:21.597779 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.597741    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af"} err="failed to get container status \"13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af\": rpc error: code = NotFound desc = could not find container \"13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af\": container with ID starting with 13c96b21ad06f90ede20e5e2b9b0fd43e5d8856020341925e872f8d44dfb68af not found: ID does not exist"
Jul 02 17:45:21.600526 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:21.600503    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6002673f-openshift-default-69cbb64699-9xlbm"]
Jul 02 17:45:23.454038 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:23.454007    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763c47b8-7938-4050-ab0d-586b1374886c" path="/var/lib/kubelet/pods/763c47b8-7938-4050-ab0d-586b1374886c/volumes"
Jul 02 17:45:45.601150 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:45.601116    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:45:45.606557 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:45:45.606534    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:46:10.151564 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.151527    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"]
Jul 02 17:46:10.152027 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.151928    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cbfd8d2-f158-4359-adb7-7f13d85077c3" containerName="maas-api"
Jul 02 17:46:10.152027 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.151944    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cbfd8d2-f158-4359-adb7-7f13d85077c3" containerName="maas-api"
Jul 02 17:46:10.152027 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.151957    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy"
Jul 02 17:46:10.152027 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.151962    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy"
Jul 02 17:46:10.152027 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.151972    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy"
Jul 02 17:46:10.152027 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.151978    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy"
Jul 02 17:46:10.152218 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.152052    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy"
Jul 02 17:46:10.152218 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.152067    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cbfd8d2-f158-4359-adb7-7f13d85077c3" containerName="maas-api"
Jul 02 17:46:10.154203 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.154180    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.156369 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.156351    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1f15ad-openshift-default-dockercfg-lkt74\""
Jul 02 17:46:10.166128 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.166103    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"]
Jul 02 17:46:10.298783 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.298747    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-podinfo\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.298973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.298795    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-credential-socket\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.298973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.298824    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-token\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.298973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.298850    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-data\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.298973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.298889    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctfc4\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-kube-api-access-ctfc4\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.298973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.298932    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istiod-ca-cert\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.298973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.298968    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-socket\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.299186 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.298984    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-envoy\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.299186 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.299000    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-certs\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.399809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.399771    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-podinfo\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400006 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.399830    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-credential-socket\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400006 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.399856    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-token\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400006 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.399887    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-data\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400006 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.399904    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctfc4\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-kube-api-access-ctfc4\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400006 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.399932    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istiod-ca-cert\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400312 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.400085    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-socket\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400312 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.400127    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-envoy\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400312 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.400160    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-certs\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400312 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.400229    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-credential-socket\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400312 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.400272    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-data\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400580 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.400453    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-socket\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400663 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.400631    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-certs\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.400822 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.400802    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istiod-ca-cert\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.402479 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.402425    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-envoy\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.402738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.402718    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-podinfo\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.408973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.408949    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-token\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.409144 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.409114    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctfc4\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-kube-api-access-ctfc4\") pod \"e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") " pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.464900 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.464860    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:10.614739 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.614713    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"]
Jul 02 17:46:10.617464 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:46:10.617440    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2a4d5b_77a8_434d_88ad_72a21dbc8334.slice/crio-16d6d0593660857fbfec00913119a105d48d45cd1aebb1836edb3bc90421588a WatchSource:0}: Error finding container 16d6d0593660857fbfec00913119a105d48d45cd1aebb1836edb3bc90421588a: Status 404 returned error can't find the container with id 16d6d0593660857fbfec00913119a105d48d45cd1aebb1836edb3bc90421588a
Jul 02 17:46:10.619741 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.619705    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:10.619807 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.619789    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:10.619843 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.619828    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:10.812171 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.812133    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" event={"ID":"fe2a4d5b-77a8-434d-88ad-72a21dbc8334","Type":"ContainerStarted","Data":"9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183"}
Jul 02 17:46:10.812368 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.812197    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" event={"ID":"fe2a4d5b-77a8-434d-88ad-72a21dbc8334","Type":"ContainerStarted","Data":"16d6d0593660857fbfec00913119a105d48d45cd1aebb1836edb3bc90421588a"}
Jul 02 17:46:10.833375 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:10.833325    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" podStartSLOduration=0.83330762 podStartE2EDuration="833.30762ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:46:10.830783377 +0000 UTC m=+2125.821743633" watchObservedRunningTime="2026-07-02 17:46:10.83330762 +0000 UTC m=+2125.824267875"
Jul 02 17:46:11.465514 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:11.465478    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:11.470450 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:11.470428    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:11.816845 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:11.816754    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:11.817747 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:11.817727    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:12.798277 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.798240    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"]
Jul 02 17:46:12.798958 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.798938    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="763c47b8-7938-4050-ab0d-586b1374886c" containerName="istio-proxy"
Jul 02 17:46:12.801514 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.801492    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:12.803400 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.803375    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-1f15ad-serving-cert\""
Jul 02 17:46:12.810286 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.810263    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"]
Jul 02 17:46:12.825223 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.825194    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:12.825382 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.825315    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qclp\" (UniqueName: \"kubernetes.io/projected/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-kube-api-access-9qclp\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:12.825382 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.825368    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:12.925940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.925907    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qclp\" (UniqueName: \"kubernetes.io/projected/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-kube-api-access-9qclp\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:12.926135 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.925956    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:12.926135 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.926017    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:12.926280 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:46:12.926132    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-1f15ad-serving-cert: secret "maas-api-e2e-inf-a-1f15ad-serving-cert" not found
Jul 02 17:46:12.926280 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:46:12.926227    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls podName:c4bc61cc-c1d2-4487-bf84-e53a2f1ae242 nodeName:}" failed. No retries permitted until 2026-07-02 17:46:13.426202943 +0000 UTC m=+2128.417163178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls") pod "maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb" (UID: "c4bc61cc-c1d2-4487-bf84-e53a2f1ae242") : secret "maas-api-e2e-inf-a-1f15ad-serving-cert" not found
Jul 02 17:46:12.926686 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.926669    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:12.935894 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:12.935869    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qclp\" (UniqueName: \"kubernetes.io/projected/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-kube-api-access-9qclp\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:13.430505 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:13.430472    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:13.432845 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:13.432824    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls\") pod \"maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") " pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:13.714639 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:13.714533    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:13.847178 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:13.847152    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"]
Jul 02 17:46:13.849916 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:46:13.849880    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4bc61cc_c1d2_4487_bf84_e53a2f1ae242.slice/crio-30c622ab8f2d21e687fbbfdbde5b16be0ad1555838065976620d75ee7e461c61 WatchSource:0}: Error finding container 30c622ab8f2d21e687fbbfdbde5b16be0ad1555838065976620d75ee7e461c61: Status 404 returned error can't find the container with id 30c622ab8f2d21e687fbbfdbde5b16be0ad1555838065976620d75ee7e461c61
Jul 02 17:46:13.851464 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:13.851441    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 17:46:14.834809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:14.834774    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb" event={"ID":"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242","Type":"ContainerStarted","Data":"53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238"}
Jul 02 17:46:14.835006 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:14.834832    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb" event={"ID":"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242","Type":"ContainerStarted","Data":"30c622ab8f2d21e687fbbfdbde5b16be0ad1555838065976620d75ee7e461c61"}
Jul 02 17:46:14.835006 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:14.834906    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:14.849798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:14.849742    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb" podStartSLOduration=2.374077061 podStartE2EDuration="2.849723869s" totalImagesPullingTime="475.646808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:46:14.84936404 +0000 UTC m=+2129.840324294" watchObservedRunningTime="2026-07-02 17:46:14.849723869 +0000 UTC m=+2129.840684125"
Jul 02 17:46:17.861650 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.861618    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"]
Jul 02 17:46:17.865239 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.865219    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.867189 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.867166    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1fad4f-openshift-default-dockercfg-m5pst\""
Jul 02 17:46:17.876554 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.876528    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"]
Jul 02 17:46:17.969360 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969307    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcspf\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-kube-api-access-gcspf\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.969558 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969371    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-envoy\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.969558 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969405    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-token\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.969558 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969439    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-podinfo\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.969558 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969467    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-certs\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.969558 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969492    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istiod-ca-cert\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.969961 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969553    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-credential-socket\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.969961 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969603    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-data\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:17.969961 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:17.969696    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-socket\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070308 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070251    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcspf\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-kube-api-access-gcspf\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070308 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070312    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-envoy\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070541 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070331    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-token\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070541 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070356    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-podinfo\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070541 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070384    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-certs\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070727 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070554    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istiod-ca-cert\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070717    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-credential-socket\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070760    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-data\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070908 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070843    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-certs\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.070908 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.070868    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-socket\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.071038 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.071017    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-credential-socket\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.071150 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.071108    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-data\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.071150 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.071113    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-socket\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.071363 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.071342    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istiod-ca-cert\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.073231 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.073210    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-envoy\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.073362 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.073346    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-podinfo\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.081990 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.081960    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-token\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.082461 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.082443    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcspf\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-kube-api-access-gcspf\") pod \"e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") " pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.177747 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.177707    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:18.319741 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.319713    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"]
Jul 02 17:46:18.321415 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:46:18.321385    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6efa93_5c63_4bf0_90d5_a8bc4a362939.slice/crio-0ebca327b102bf2d75a6ae5eac564048dd46b7c1a4edf2c25babed5c5a7b64ea WatchSource:0}: Error finding container 0ebca327b102bf2d75a6ae5eac564048dd46b7c1a4edf2c25babed5c5a7b64ea: Status 404 returned error can't find the container with id 0ebca327b102bf2d75a6ae5eac564048dd46b7c1a4edf2c25babed5c5a7b64ea
Jul 02 17:46:18.323638 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.323581    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:18.323715 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.323674    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:18.323715 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.323704    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:18.855846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.855797    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" event={"ID":"fa6efa93-5c63-4bf0-90d5-a8bc4a362939","Type":"ContainerStarted","Data":"b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c"}
Jul 02 17:46:18.856006 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.855869    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" event={"ID":"fa6efa93-5c63-4bf0-90d5-a8bc4a362939","Type":"ContainerStarted","Data":"0ebca327b102bf2d75a6ae5eac564048dd46b7c1a4edf2c25babed5c5a7b64ea"}
Jul 02 17:46:18.876143 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:18.876097    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" podStartSLOduration=1.8760803 podStartE2EDuration="1.8760803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:46:18.873926082 +0000 UTC m=+2133.864886349" watchObservedRunningTime="2026-07-02 17:46:18.8760803 +0000 UTC m=+2133.867040554"
Jul 02 17:46:19.177734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:19.177697    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:19.182732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:19.182704    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:19.861145 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:19.861109    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:19.862264 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:19.862244    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:20.839066 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.839030    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"]
Jul 02 17:46:20.843261 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.843234    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:20.845254 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.845227    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-1fad4f-serving-cert\""
Jul 02 17:46:20.845511 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.845490    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:46:20.853947 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.853718    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"]
Jul 02 17:46:20.897291 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.897251    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:20.897471 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.897433    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c7545b-75b1-44b3-9fba-de55bf52e68d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:20.897980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.897948    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4lts\" (UniqueName: \"kubernetes.io/projected/63c7545b-75b1-44b3-9fba-de55bf52e68d-kube-api-access-r4lts\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:20.999566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.999533    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:20.999566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.999571    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c7545b-75b1-44b3-9fba-de55bf52e68d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:20.999857 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:20.999691    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4lts\" (UniqueName: \"kubernetes.io/projected/63c7545b-75b1-44b3-9fba-de55bf52e68d-kube-api-access-r4lts\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:20.999857 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:46:20.999720    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-1fad4f-serving-cert: secret "maas-api-e2e-inf-b-1fad4f-serving-cert" not found
Jul 02 17:46:20.999857 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:46:20.999806    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls podName:63c7545b-75b1-44b3-9fba-de55bf52e68d nodeName:}" failed. No retries permitted until 2026-07-02 17:46:21.499778029 +0000 UTC m=+2136.490738284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls") pod "maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6" (UID: "63c7545b-75b1-44b3-9fba-de55bf52e68d") : secret "maas-api-e2e-inf-b-1fad4f-serving-cert" not found
Jul 02 17:46:21.000555 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:21.000530    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c7545b-75b1-44b3-9fba-de55bf52e68d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:21.013617 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:21.013559    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4lts\" (UniqueName: \"kubernetes.io/projected/63c7545b-75b1-44b3-9fba-de55bf52e68d-kube-api-access-r4lts\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:21.505314 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:21.505273    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:21.509444 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:21.509405    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls\") pod \"maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") " pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:21.758683 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:21.758577    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:21.944280 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:21.944248    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"]
Jul 02 17:46:21.947397 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:46:21.947369    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c7545b_75b1_44b3_9fba_de55bf52e68d.slice/crio-ee7522fdb92571330e621db0ed57a9009bb8cc9d32bc3be00c3704d763446f44 WatchSource:0}: Error finding container ee7522fdb92571330e621db0ed57a9009bb8cc9d32bc3be00c3704d763446f44: Status 404 returned error can't find the container with id ee7522fdb92571330e621db0ed57a9009bb8cc9d32bc3be00c3704d763446f44
Jul 02 17:46:22.879675 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:22.879638    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6" event={"ID":"63c7545b-75b1-44b3-9fba-de55bf52e68d","Type":"ContainerStarted","Data":"744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44"}
Jul 02 17:46:22.879897 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:22.879695    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6" event={"ID":"63c7545b-75b1-44b3-9fba-de55bf52e68d","Type":"ContainerStarted","Data":"ee7522fdb92571330e621db0ed57a9009bb8cc9d32bc3be00c3704d763446f44"}
Jul 02 17:46:22.879897 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:22.879766    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:22.901019 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:22.900940    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6" podStartSLOduration=2.558081962 podStartE2EDuration="2.900917822s" totalImagesPullingTime="342.83586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:46:22.897957275 +0000 UTC m=+2137.888917533" watchObservedRunningTime="2026-07-02 17:46:22.900917822 +0000 UTC m=+2137.891878069"
Jul 02 17:46:27.857853 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:27.857798    2550 patch_prober.go:28] interesting pod/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 17:46:27.858263 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:27.857881    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 17:46:28.889894 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:28.889862    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:46:28.917134 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:28.917091    2550 generic.go:356] "Generic (PLEG): container finished" podID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerID="9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183" exitCode=0
Jul 02 17:46:28.917332 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:28.917228    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" event={"ID":"fe2a4d5b-77a8-434d-88ad-72a21dbc8334","Type":"ContainerDied","Data":"9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183"}
Jul 02 17:46:28.917786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:28.917757    2550 scope.go:117] "RemoveContainer" containerID="9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183"
Jul 02 17:46:28.919132 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:28.919094    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:28.919239 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:28.919187    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:28.919306 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:28.919236    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:29.927444 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:29.927405    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" event={"ID":"fe2a4d5b-77a8-434d-88ad-72a21dbc8334","Type":"ContainerStarted","Data":"29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19"}
Jul 02 17:46:30.465008 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:30.464976    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:30.465231 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:30.465209    2550 patch_prober.go:28] interesting pod/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 02 17:46:30.465280 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:30.465257    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 02 17:46:31.465984 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:31.465955    2550 patch_prober.go:28] interesting pod/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 02 17:46:31.466427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:31.466404    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 02 17:46:32.465965 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:32.465929    2550 patch_prober.go:28] interesting pod/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 02 17:46:32.466149 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:32.465989    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 02 17:46:33.465959 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:33.465922    2550 patch_prober.go:28] interesting pod/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 02 17:46:33.466132 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:33.465975    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 02 17:46:34.469390 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:34.469360    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:34.469857 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:34.469622    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:34.470457 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:34.470440    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:46:34.961859 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:34.959896    2550 patch_prober.go:28] interesting pod/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": read tcp 10.134.0.2:39610->10.134.0.42:15021: read: connection reset by peer" start-of-body=
Jul 02 17:46:34.961859 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:34.959963    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": read tcp 10.134.0.2:39610->10.134.0.42:15021: read: connection reset by peer"
Jul 02 17:46:35.961273 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:35.961241    2550 generic.go:356] "Generic (PLEG): container finished" podID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerID="b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c" exitCode=0
Jul 02 17:46:35.961736 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:35.961310    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" event={"ID":"fa6efa93-5c63-4bf0-90d5-a8bc4a362939","Type":"ContainerDied","Data":"b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c"}
Jul 02 17:46:35.961811 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:35.961798    2550 scope.go:117] "RemoveContainer" containerID="b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c"
Jul 02 17:46:35.962782 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:35.962755    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:35.962895 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:35.962820    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:35.962895 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:35.962861    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:46:36.968051 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:36.968019    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" event={"ID":"fa6efa93-5c63-4bf0-90d5-a8bc4a362939","Type":"ContainerStarted","Data":"560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a"}
Jul 02 17:46:37.177844 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:37.177803    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:37.178029 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:37.178008    2550 patch_prober.go:28] interesting pod/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 02 17:46:37.178072 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:37.178057    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 02 17:46:38.178572 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:38.178538    2550 patch_prober.go:28] interesting pod/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 02 17:46:38.178985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:38.178627    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 02 17:46:39.178795 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:39.178758    2550 patch_prober.go:28] interesting pod/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 02 17:46:39.179181 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:39.178824    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 02 17:46:40.178814 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:40.178772    2550 patch_prober.go:28] interesting pod/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 02 17:46:40.179281 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:40.178834    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 02 17:46:41.181701 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:41.181667    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:41.182081 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:41.182063    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:46:41.182798 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:46:41.182779    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:48:06.701967 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:06.701757    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"]
Jul 02 17:48:06.702613 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:06.702557    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb" podUID="c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" containerName="maas-api" containerID="cri-o://53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238" gracePeriod=30
Jul 02 17:48:07.153331 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.153304    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:48:07.247045 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.246960    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls\") pod \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") "
Jul 02 17:48:07.247045 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.247031    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qclp\" (UniqueName: \"kubernetes.io/projected/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-kube-api-access-9qclp\") pod \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") "
Jul 02 17:48:07.247272 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.247143    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-openshift-service-ca\") pod \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\" (UID: \"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242\") "
Jul 02 17:48:07.247510 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.247474    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" (UID: "c4bc61cc-c1d2-4487-bf84-e53a2f1ae242"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:48:07.249171 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.249150    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-kube-api-access-9qclp" (OuterVolumeSpecName: "kube-api-access-9qclp") pod "c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" (UID: "c4bc61cc-c1d2-4487-bf84-e53a2f1ae242"). InnerVolumeSpecName "kube-api-access-9qclp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:48:07.249171 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.249159    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" (UID: "c4bc61cc-c1d2-4487-bf84-e53a2f1ae242"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:48:07.348698 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.348663    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:07.348698 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.348694    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:07.348698 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.348703    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qclp\" (UniqueName: \"kubernetes.io/projected/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242-kube-api-access-9qclp\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:07.418016 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.417979    2550 generic.go:356] "Generic (PLEG): container finished" podID="c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" containerID="53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238" exitCode=0
Jul 02 17:48:07.418196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.418027    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"
Jul 02 17:48:07.418196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.418056    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb" event={"ID":"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242","Type":"ContainerDied","Data":"53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238"}
Jul 02 17:48:07.418196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.418096    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb" event={"ID":"c4bc61cc-c1d2-4487-bf84-e53a2f1ae242","Type":"ContainerDied","Data":"30c622ab8f2d21e687fbbfdbde5b16be0ad1555838065976620d75ee7e461c61"}
Jul 02 17:48:07.418196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.418117    2550 scope.go:117] "RemoveContainer" containerID="53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238"
Jul 02 17:48:07.430011 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.429990    2550 scope.go:117] "RemoveContainer" containerID="53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238"
Jul 02 17:48:07.430329 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:48:07.430311    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238\": container with ID starting with 53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238 not found: ID does not exist" containerID="53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238"
Jul 02 17:48:07.430390 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.430338    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238"} err="failed to get container status \"53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238\": rpc error: code = NotFound desc = could not find container \"53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238\": container with ID starting with 53ac330e3f6c2270487e1a3684097c7078153fe8905b9230713db0df4018d238 not found: ID does not exist"
Jul 02 17:48:07.441803 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.441773    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"]
Jul 02 17:48:07.445795 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.445768    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-1f15ad-5999fb5c96-7z2mb"]
Jul 02 17:48:07.454888 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:07.454855    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" path="/var/lib/kubelet/pods/c4bc61cc-c1d2-4487-bf84-e53a2f1ae242/volumes"
Jul 02 17:48:48.174408 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:48.174375    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"]
Jul 02 17:48:48.174867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:48.174623    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy" containerID="cri-o://29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19" gracePeriod=30
Jul 02 17:48:49.236638 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.236584    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"]
Jul 02 17:48:49.237214 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.237178    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6" podUID="63c7545b-75b1-44b3-9fba-de55bf52e68d" containerName="maas-api" containerID="cri-o://744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44" gracePeriod=30
Jul 02 17:48:49.472293 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.472262    2550 patch_prober.go:28] interesting pod/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 17:48:49.472424 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.472321    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:48:49.493767 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.493688    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:48:49.618552 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.618517    2550 generic.go:356] "Generic (PLEG): container finished" podID="63c7545b-75b1-44b3-9fba-de55bf52e68d" containerID="744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44" exitCode=0
Jul 02 17:48:49.618757 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.618565    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"
Jul 02 17:48:49.618757 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.618622    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6" event={"ID":"63c7545b-75b1-44b3-9fba-de55bf52e68d","Type":"ContainerDied","Data":"744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44"}
Jul 02 17:48:49.618757 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.618711    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6" event={"ID":"63c7545b-75b1-44b3-9fba-de55bf52e68d","Type":"ContainerDied","Data":"ee7522fdb92571330e621db0ed57a9009bb8cc9d32bc3be00c3704d763446f44"}
Jul 02 17:48:49.618757 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.618740    2550 scope.go:117] "RemoveContainer" containerID="744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44"
Jul 02 17:48:49.627212 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.627188    2550 scope.go:117] "RemoveContainer" containerID="744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44"
Jul 02 17:48:49.627507 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:48:49.627489    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44\": container with ID starting with 744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44 not found: ID does not exist" containerID="744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44"
Jul 02 17:48:49.627563 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.627517    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44"} err="failed to get container status \"744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44\": rpc error: code = NotFound desc = could not find container \"744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44\": container with ID starting with 744b40c5e753aa093d2d095cde8a0ce73ab548eb9386f602efefcf7c29f21b44 not found: ID does not exist"
Jul 02 17:48:49.661572 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.661539    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls\") pod \"63c7545b-75b1-44b3-9fba-de55bf52e68d\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") "
Jul 02 17:48:49.661755 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.661616    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c7545b-75b1-44b3-9fba-de55bf52e68d-openshift-service-ca\") pod \"63c7545b-75b1-44b3-9fba-de55bf52e68d\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") "
Jul 02 17:48:49.661755 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.661680    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4lts\" (UniqueName: \"kubernetes.io/projected/63c7545b-75b1-44b3-9fba-de55bf52e68d-kube-api-access-r4lts\") pod \"63c7545b-75b1-44b3-9fba-de55bf52e68d\" (UID: \"63c7545b-75b1-44b3-9fba-de55bf52e68d\") "
Jul 02 17:48:49.662031 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.662010    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63c7545b-75b1-44b3-9fba-de55bf52e68d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "63c7545b-75b1-44b3-9fba-de55bf52e68d" (UID: "63c7545b-75b1-44b3-9fba-de55bf52e68d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:48:49.663797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.663768    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c7545b-75b1-44b3-9fba-de55bf52e68d-kube-api-access-r4lts" (OuterVolumeSpecName: "kube-api-access-r4lts") pod "63c7545b-75b1-44b3-9fba-de55bf52e68d" (UID: "63c7545b-75b1-44b3-9fba-de55bf52e68d"). InnerVolumeSpecName "kube-api-access-r4lts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:48:49.663907 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.663815    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "63c7545b-75b1-44b3-9fba-de55bf52e68d" (UID: "63c7545b-75b1-44b3-9fba-de55bf52e68d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:48:49.763336 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.763239    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/63c7545b-75b1-44b3-9fba-de55bf52e68d-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:49.763336 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.763274    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/63c7545b-75b1-44b3-9fba-de55bf52e68d-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:49.763336 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.763284    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4lts\" (UniqueName: \"kubernetes.io/projected/63c7545b-75b1-44b3-9fba-de55bf52e68d-kube-api-access-r4lts\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:49.938846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.938814    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"]
Jul 02 17:48:49.942566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:49.942538    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-1fad4f-74885dd477-qwfc6"]
Jul 02 17:48:51.455057 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:51.455022    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63c7545b-75b1-44b3-9fba-de55bf52e68d" path="/var/lib/kubelet/pods/63c7545b-75b1-44b3-9fba-de55bf52e68d/volumes"
Jul 02 17:48:53.434704 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.434637    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:48:53.603197 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603163    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-envoy\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603197 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603198    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-data\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603220    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istiod-ca-cert\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603266    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctfc4\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-kube-api-access-ctfc4\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603300    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-certs\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603326    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-token\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603385    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-socket\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603462 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603436    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-podinfo\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603900 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603469    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-credential-socket\") pod \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\" (UID: \"fe2a4d5b-77a8-434d-88ad-72a21dbc8334\") "
Jul 02 17:48:53.603900 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603724    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:53.603900 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603818    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:48:53.603900 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.603863    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:53.604493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.604004    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:53.604493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.604116    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:53.604493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.604119    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:53.605614 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.605555    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:48:53.605731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.605715    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-kube-api-access-ctfc4" (OuterVolumeSpecName: "kube-api-access-ctfc4") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "kube-api-access-ctfc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:48:53.605913 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.605882    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:48:53.605998 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.605931    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe2a4d5b-77a8-434d-88ad-72a21dbc8334" (UID: "fe2a4d5b-77a8-434d-88ad-72a21dbc8334"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:48:53.640013 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.639973    2550 generic.go:356] "Generic (PLEG): container finished" podID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerID="29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19" exitCode=0
Jul 02 17:48:53.640213 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.640027    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"
Jul 02 17:48:53.640213 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.640064    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" event={"ID":"fe2a4d5b-77a8-434d-88ad-72a21dbc8334","Type":"ContainerDied","Data":"29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19"}
Jul 02 17:48:53.640213 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.640133    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps" event={"ID":"fe2a4d5b-77a8-434d-88ad-72a21dbc8334","Type":"ContainerDied","Data":"16d6d0593660857fbfec00913119a105d48d45cd1aebb1836edb3bc90421588a"}
Jul 02 17:48:53.640213 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.640163    2550 scope.go:117] "RemoveContainer" containerID="29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19"
Jul 02 17:48:53.650071 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.650051    2550 scope.go:117] "RemoveContainer" containerID="9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183"
Jul 02 17:48:53.658310 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.658288    2550 scope.go:117] "RemoveContainer" containerID="29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19"
Jul 02 17:48:53.658631 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:48:53.658605    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19\": container with ID starting with 29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19 not found: ID does not exist" containerID="29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19"
Jul 02 17:48:53.658714 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.658640    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19"} err="failed to get container status \"29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19\": rpc error: code = NotFound desc = could not find container \"29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19\": container with ID starting with 29c10321901d6ee4bf1bc1375769525da28774cc0d88b61eb4bcb9ea1f20ea19 not found: ID does not exist"
Jul 02 17:48:53.658714 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.658660    2550 scope.go:117] "RemoveContainer" containerID="9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183"
Jul 02 17:48:53.658985 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:48:53.658962    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183\": container with ID starting with 9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183 not found: ID does not exist" containerID="9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183"
Jul 02 17:48:53.659028 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.658994    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183"} err="failed to get container status \"9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183\": rpc error: code = NotFound desc = could not find container \"9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183\": container with ID starting with 9251a71ddb4aa53b8139d0ab4c496e98355af6851fd7955de627c94ecf490183 not found: ID does not exist"
Jul 02 17:48:53.661458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.661437    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"]
Jul 02 17:48:53.665265 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.665243    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1f15ad-openshift-default-5cd5d67bbf-7rsps"]
Jul 02 17:48:53.705196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.705104    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:53.705196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.705130    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:53.705196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.705142    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:53.705196 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.705156    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:53.705436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.705204    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:53.705436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.705215    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:53.705436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.705228    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:53.705436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:53.705239    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctfc4\" (UniqueName: \"kubernetes.io/projected/fe2a4d5b-77a8-434d-88ad-72a21dbc8334-kube-api-access-ctfc4\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:48:54.929262 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:54.929221    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"]
Jul 02 17:48:54.929687 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:54.929476    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy" containerID="cri-o://560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a" gracePeriod=30
Jul 02 17:48:55.454295 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.454258    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" path="/var/lib/kubelet/pods/fe2a4d5b-77a8-434d-88ad-72a21dbc8334/volumes"
Jul 02 17:48:55.791121 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791043    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"]
Jul 02 17:48:55.791404 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791392    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" containerName="maas-api"
Jul 02 17:48:55.791447 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791405    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" containerName="maas-api"
Jul 02 17:48:55.791447 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791420    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy"
Jul 02 17:48:55.791447 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791425    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy"
Jul 02 17:48:55.791447 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791433    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy"
Jul 02 17:48:55.791447 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791439    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy"
Jul 02 17:48:55.791631 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791449    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c7545b-75b1-44b3-9fba-de55bf52e68d" containerName="maas-api"
Jul 02 17:48:55.791631 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791455    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c7545b-75b1-44b3-9fba-de55bf52e68d" containerName="maas-api"
Jul 02 17:48:55.791631 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791530    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4bc61cc-c1d2-4487-bf84-e53a2f1ae242" containerName="maas-api"
Jul 02 17:48:55.791631 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791540    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c7545b-75b1-44b3-9fba-de55bf52e68d" containerName="maas-api"
Jul 02 17:48:55.791631 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.791545    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy"
Jul 02 17:48:55.794427 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.794404    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.796412 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.796393    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9dc1ed-openshift-default-dockercfg-6f754\""
Jul 02 17:48:55.807458 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.807431    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"]
Jul 02 17:48:55.824254 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824213    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b289e7f-845b-49d5-8a79-b50b8d953efe-istiod-ca-cert\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.824254 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824256    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-certs\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.824488 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824303    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-socket\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.824488 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824324    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-data\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.824488 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824345    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-podinfo\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.824488 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824370    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-credential-socket\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.824681 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824493    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmbqw\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-kube-api-access-bmbqw\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.824681 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824517    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-envoy\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.824681 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.824535    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-token\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.925147 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925105    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmbqw\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-kube-api-access-bmbqw\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.925350 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925152    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-envoy\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.925350 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925181    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-token\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.925474 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925394    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b289e7f-845b-49d5-8a79-b50b8d953efe-istiod-ca-cert\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.925529 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925491    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-certs\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.925624 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925582    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-socket\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.925809 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925791    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-data\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.925942 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925926    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-podinfo\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.926133 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.926111    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-data\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.926228 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925869    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-certs\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.926228 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.925935    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-socket\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.926228 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.926188    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-credential-socket\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.926379 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.926192    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b289e7f-845b-49d5-8a79-b50b8d953efe-istiod-ca-cert\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.926426 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.926390    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-credential-socket\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.928303 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.928171    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-envoy\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.930904 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.930853    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-podinfo\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.933721 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.933694    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-token\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:55.934211 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:55.934187    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmbqw\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-kube-api-access-bmbqw\") pod \"e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") " pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:56.104853 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.104769    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:56.185302 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.184478    2550 patch_prober.go:28] interesting pod/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 17:48:56.185302 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.184545    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 17:48:56.241876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.241849    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"]
Jul 02 17:48:56.244407 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:48:56.244375    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b289e7f_845b_49d5_8a79_b50b8d953efe.slice/crio-e007ab2e236cdcb39d9a262a7e078db6137b7aa64237c1a2aba8611bd7c64894 WatchSource:0}: Error finding container e007ab2e236cdcb39d9a262a7e078db6137b7aa64237c1a2aba8611bd7c64894: Status 404 returned error can't find the container with id e007ab2e236cdcb39d9a262a7e078db6137b7aa64237c1a2aba8611bd7c64894
Jul 02 17:48:56.246739 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.246705    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:48:56.246833 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.246769    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:48:56.246833 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.246800    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:48:56.659912 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.659872    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" event={"ID":"8b289e7f-845b-49d5-8a79-b50b8d953efe","Type":"ContainerStarted","Data":"e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e"}
Jul 02 17:48:56.660081 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.659947    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" event={"ID":"8b289e7f-845b-49d5-8a79-b50b8d953efe","Type":"ContainerStarted","Data":"e007ab2e236cdcb39d9a262a7e078db6137b7aa64237c1a2aba8611bd7c64894"}
Jul 02 17:48:56.685688 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:56.685625    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" podStartSLOduration=1.685608987 podStartE2EDuration="1.685608987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:48:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:48:56.68335908 +0000 UTC m=+2291.674319359" watchObservedRunningTime="2026-07-02 17:48:56.685608987 +0000 UTC m=+2291.676569233"
Jul 02 17:48:57.105508 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:57.105407    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:57.110373 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:57.110347    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:57.664862 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:57.664828    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:57.665793 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:57.665776    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:48:58.665877 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.665840    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"]
Jul 02 17:48:58.666546 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.666527    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe2a4d5b-77a8-434d-88ad-72a21dbc8334" containerName="istio-proxy"
Jul 02 17:48:58.668734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.668713    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:58.670712 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.670684    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-9dc1ed-serving-cert\""
Jul 02 17:48:58.680008 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.679988    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"]
Jul 02 17:48:58.751965 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.751929    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/103cfaa4-2fb0-4900-82d5-3afa262e75e1-openshift-service-ca\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:58.751965 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.751972    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89bdx\" (UniqueName: \"kubernetes.io/projected/103cfaa4-2fb0-4900-82d5-3afa262e75e1-kube-api-access-89bdx\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:58.752199 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.752042    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:58.853278 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.853226    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/103cfaa4-2fb0-4900-82d5-3afa262e75e1-openshift-service-ca\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:58.853278 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.853286    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89bdx\" (UniqueName: \"kubernetes.io/projected/103cfaa4-2fb0-4900-82d5-3afa262e75e1-kube-api-access-89bdx\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:58.853497 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.853335    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:58.853538 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:48:58.853516    2550 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-9dc1ed-serving-cert: secret "maas-api-e2e-api-a-9dc1ed-serving-cert" not found
Jul 02 17:48:58.853643 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:48:58.853620    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls podName:103cfaa4-2fb0-4900-82d5-3afa262e75e1 nodeName:}" failed. No retries permitted until 2026-07-02 17:48:59.353572434 +0000 UTC m=+2294.344532671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls") pod "maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc" (UID: "103cfaa4-2fb0-4900-82d5-3afa262e75e1") : secret "maas-api-e2e-api-a-9dc1ed-serving-cert" not found
Jul 02 17:48:58.853931 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.853915    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/103cfaa4-2fb0-4900-82d5-3afa262e75e1-openshift-service-ca\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:58.861476 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:58.861457    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89bdx\" (UniqueName: \"kubernetes.io/projected/103cfaa4-2fb0-4900-82d5-3afa262e75e1-kube-api-access-89bdx\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:59.358972 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:59.358936    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:59.361490 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:59.361462    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls\") pod \"maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") " pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:59.580292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:59.580190    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:48:59.715982 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:48:59.715955    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"]
Jul 02 17:48:59.717866 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:48:59.717829    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod103cfaa4_2fb0_4900_82d5_3afa262e75e1.slice/crio-1ab22cfdc3a08521bf9a2d1c55d12a453fb141d1f72e74b8cf59616b27e23e79 WatchSource:0}: Error finding container 1ab22cfdc3a08521bf9a2d1c55d12a453fb141d1f72e74b8cf59616b27e23e79: Status 404 returned error can't find the container with id 1ab22cfdc3a08521bf9a2d1c55d12a453fb141d1f72e74b8cf59616b27e23e79
Jul 02 17:49:00.177344 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.177322    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:49:00.266539 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266505    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-certs\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.266738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266549    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-envoy\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.266738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266570    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-socket\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.266738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266643    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-podinfo\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.266738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266663    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcspf\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-kube-api-access-gcspf\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.266738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266703    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-credential-socket\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.267069 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266871    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-data\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.267069 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266927    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-token\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.267069 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.266970    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istiod-ca-cert\") pod \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\" (UID: \"fa6efa93-5c63-4bf0-90d5-a8bc4a362939\") "
Jul 02 17:49:00.267230 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.267207    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:00.267302 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.267222    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:00.267302 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.267250    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:00.267411 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.267322    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.267411 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.267340    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.267411 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.267352    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.267566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.267532    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:49:00.267867 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.267833    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:00.269004 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.268972    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:49:00.269110 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.269042    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-kube-api-access-gcspf" (OuterVolumeSpecName: "kube-api-access-gcspf") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "kube-api-access-gcspf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:49:00.269157 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.269133    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:00.269268 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.269252    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa6efa93-5c63-4bf0-90d5-a8bc4a362939" (UID: "fa6efa93-5c63-4bf0-90d5-a8bc4a362939"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:49:00.368082 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.368049    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.368082 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.368074    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.368082 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.368084    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcspf\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-kube-api-access-gcspf\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.368082 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.368092    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.368342 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.368101    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.368342 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.368110    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa6efa93-5c63-4bf0-90d5-a8bc4a362939-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:00.681024 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.680990    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc" event={"ID":"103cfaa4-2fb0-4900-82d5-3afa262e75e1","Type":"ContainerStarted","Data":"ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283"}
Jul 02 17:49:00.681255 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.681047    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc" event={"ID":"103cfaa4-2fb0-4900-82d5-3afa262e75e1","Type":"ContainerStarted","Data":"1ab22cfdc3a08521bf9a2d1c55d12a453fb141d1f72e74b8cf59616b27e23e79"}
Jul 02 17:49:00.681255 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.681092    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:49:00.682743 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.682719    2550 generic.go:356] "Generic (PLEG): container finished" podID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerID="560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a" exitCode=0
Jul 02 17:49:00.682846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.682746    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" event={"ID":"fa6efa93-5c63-4bf0-90d5-a8bc4a362939","Type":"ContainerDied","Data":"560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a"}
Jul 02 17:49:00.682846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.682766    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"
Jul 02 17:49:00.682846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.682795    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm" event={"ID":"fa6efa93-5c63-4bf0-90d5-a8bc4a362939","Type":"ContainerDied","Data":"0ebca327b102bf2d75a6ae5eac564048dd46b7c1a4edf2c25babed5c5a7b64ea"}
Jul 02 17:49:00.682846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.682820    2550 scope.go:117] "RemoveContainer" containerID="560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a"
Jul 02 17:49:00.691494 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.691477    2550 scope.go:117] "RemoveContainer" containerID="b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c"
Jul 02 17:49:00.699781 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.699739    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc" podStartSLOduration=2.242685481 podStartE2EDuration="2.699725228s" totalImagesPullingTime="457.039747ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:49:00.696568586 +0000 UTC m=+2295.687528841" watchObservedRunningTime="2026-07-02 17:49:00.699725228 +0000 UTC m=+2295.690685483"
Jul 02 17:49:00.702124 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.702097    2550 scope.go:117] "RemoveContainer" containerID="560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a"
Jul 02 17:49:00.703170 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:49:00.703136    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a\": container with ID starting with 560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a not found: ID does not exist" containerID="560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a"
Jul 02 17:49:00.703273 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.703182    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a"} err="failed to get container status \"560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a\": rpc error: code = NotFound desc = could not find container \"560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a\": container with ID starting with 560c5e60ba9dff83d63886dbd0b8e788705fb4f80c207977c0f4893c9ef56a0a not found: ID does not exist"
Jul 02 17:49:00.703273 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.703200    2550 scope.go:117] "RemoveContainer" containerID="b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c"
Jul 02 17:49:00.703737 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:49:00.703719    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c\": container with ID starting with b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c not found: ID does not exist" containerID="b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c"
Jul 02 17:49:00.703795 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.703741    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c"} err="failed to get container status \"b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c\": rpc error: code = NotFound desc = could not find container \"b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c\": container with ID starting with b0e55a769f0566fee860b52f089d95da8723a78b3a732f5c2c4ead1337929d1c not found: ID does not exist"
Jul 02 17:49:00.708550 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.708530    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"]
Jul 02 17:49:00.714201 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:00.714180    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1fad4f-openshift-default-7b94c9c67f-g28pm"]
Jul 02 17:49:01.454781 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:01.454748    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" path="/var/lib/kubelet/pods/fa6efa93-5c63-4bf0-90d5-a8bc4a362939/volumes"
Jul 02 17:49:03.825455 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.825415    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"]
Jul 02 17:49:03.825875 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.825858    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy"
Jul 02 17:49:03.825919 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.825878    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy"
Jul 02 17:49:03.825919 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.825895    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy"
Jul 02 17:49:03.825919 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.825901    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy"
Jul 02 17:49:03.826020 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.825972    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy"
Jul 02 17:49:03.826020 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.825980    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6efa93-5c63-4bf0-90d5-a8bc4a362939" containerName="istio-proxy"
Jul 02 17:49:03.828871 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.828848    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.830828 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.830808    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1b97a7-openshift-default-dockercfg-d47bx\""
Jul 02 17:49:03.840747 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.840719    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"]
Jul 02 17:49:03.904544 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904509    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-credential-socket\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.904769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904566    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-socket\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.904769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904585    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-envoy\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.904769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904715    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-certs\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.904769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904761    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-data\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.904964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904802    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-podinfo\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.904964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904833    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01773f11-b594-49d4-a48c-ee6fd9a911cd-istiod-ca-cert\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.904964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904849    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-token\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:03.904964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:03.904865    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j42c\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-kube-api-access-9j42c\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005477 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005433    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-data\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005477 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005475    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-podinfo\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005508    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01773f11-b594-49d4-a48c-ee6fd9a911cd-istiod-ca-cert\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005526    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-token\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005544    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j42c\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-kube-api-access-9j42c\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005584    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-credential-socket\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005651    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-socket\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005676    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-envoy\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.005787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005751    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-certs\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.006107 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.005970    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-data\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.006107 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.006043    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-socket\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.006107 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.006063    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-credential-socket\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.006221 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.006115    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-certs\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.006473 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.006455    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01773f11-b594-49d4-a48c-ee6fd9a911cd-istiod-ca-cert\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.008042 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.008011    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-envoy\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.008213 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.008195    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-podinfo\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.012414 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.012386    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-token\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.012861 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.012841    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j42c\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-kube-api-access-9j42c\") pod \"e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") " pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.139650 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.139619    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:04.279246 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.279216    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"]
Jul 02 17:49:04.281645 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:49:04.281617    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01773f11_b594_49d4_a48c_ee6fd9a911cd.slice/crio-c27b29a7b54410529d9aeb8b997f1bbb5e53fb39d32d1ba37b5176e61d6328c0 WatchSource:0}: Error finding container c27b29a7b54410529d9aeb8b997f1bbb5e53fb39d32d1ba37b5176e61d6328c0: Status 404 returned error can't find the container with id c27b29a7b54410529d9aeb8b997f1bbb5e53fb39d32d1ba37b5176e61d6328c0
Jul 02 17:49:04.284025 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.283991    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:04.284120 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.284058    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:04.284120 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.284087    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:04.707197 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.707165    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" event={"ID":"01773f11-b594-49d4-a48c-ee6fd9a911cd","Type":"ContainerStarted","Data":"c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5"}
Jul 02 17:49:04.707372 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.707219    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" event={"ID":"01773f11-b594-49d4-a48c-ee6fd9a911cd","Type":"ContainerStarted","Data":"c27b29a7b54410529d9aeb8b997f1bbb5e53fb39d32d1ba37b5176e61d6328c0"}
Jul 02 17:49:04.730364 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:04.730311    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" podStartSLOduration=1.730294486 podStartE2EDuration="1.730294486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:49:04.727989894 +0000 UTC m=+2299.718950174" watchObservedRunningTime="2026-07-02 17:49:04.730294486 +0000 UTC m=+2299.721254740"
Jul 02 17:49:05.140202 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:05.140166    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:05.144942 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:05.144916    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:05.712686 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:05.712655    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:05.713905 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:05.713880    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:06.696879 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:06.696851    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:49:13.706788 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:13.706751    2550 patch_prober.go:28] interesting pod/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 17:49:13.707139 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:13.706815    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 17:49:15.764734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:15.764699    2550 generic.go:356] "Generic (PLEG): container finished" podID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerID="e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e" exitCode=0
Jul 02 17:49:15.765248 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:15.764773    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" event={"ID":"8b289e7f-845b-49d5-8a79-b50b8d953efe","Type":"ContainerDied","Data":"e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e"}
Jul 02 17:49:15.765248 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:15.765174    2550 scope.go:117] "RemoveContainer" containerID="e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e"
Jul 02 17:49:15.766201 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:15.766177    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:15.766265 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:15.766241    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:15.766301 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:15.766272    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:16.775415 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:16.775381    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" event={"ID":"8b289e7f-845b-49d5-8a79-b50b8d953efe","Type":"ContainerStarted","Data":"ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753"}
Jul 02 17:49:17.105779 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:17.105662    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:49:17.105985 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:17.105922    2550 patch_prober.go:28] interesting pod/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 02 17:49:17.106101 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:17.106009    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 02 17:49:18.106244 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:18.106198    2550 patch_prober.go:28] interesting pod/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 02 17:49:18.106784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:18.106273    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 02 17:49:19.105415 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:19.105374    2550 patch_prober.go:28] interesting pod/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 02 17:49:19.106151 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:19.105710    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 02 17:49:19.944332 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:19.944296    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"]
Jul 02 17:49:19.944814 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:19.944538    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc" podUID="103cfaa4-2fb0-4900-82d5-3afa262e75e1" containerName="maas-api" containerID="cri-o://ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283" gracePeriod=30
Jul 02 17:49:20.105689 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.105201    2550 patch_prober.go:28] interesting pod/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 02 17:49:20.105689 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.105262    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 02 17:49:20.230400 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.230371    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:49:20.376080 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.376045    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89bdx\" (UniqueName: \"kubernetes.io/projected/103cfaa4-2fb0-4900-82d5-3afa262e75e1-kube-api-access-89bdx\") pod \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") "
Jul 02 17:49:20.376269 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.376096    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/103cfaa4-2fb0-4900-82d5-3afa262e75e1-openshift-service-ca\") pod \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") "
Jul 02 17:49:20.376269 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.376127    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls\") pod \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\" (UID: \"103cfaa4-2fb0-4900-82d5-3afa262e75e1\") "
Jul 02 17:49:20.376476 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.376451    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103cfaa4-2fb0-4900-82d5-3afa262e75e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "103cfaa4-2fb0-4900-82d5-3afa262e75e1" (UID: "103cfaa4-2fb0-4900-82d5-3afa262e75e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:49:20.378261 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.378226    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "103cfaa4-2fb0-4900-82d5-3afa262e75e1" (UID: "103cfaa4-2fb0-4900-82d5-3afa262e75e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:49:20.378378 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.378311    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/103cfaa4-2fb0-4900-82d5-3afa262e75e1-kube-api-access-89bdx" (OuterVolumeSpecName: "kube-api-access-89bdx") pod "103cfaa4-2fb0-4900-82d5-3afa262e75e1" (UID: "103cfaa4-2fb0-4900-82d5-3afa262e75e1"). InnerVolumeSpecName "kube-api-access-89bdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:49:20.477317 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.477238    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89bdx\" (UniqueName: \"kubernetes.io/projected/103cfaa4-2fb0-4900-82d5-3afa262e75e1-kube-api-access-89bdx\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:20.477317 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.477268    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/103cfaa4-2fb0-4900-82d5-3afa262e75e1-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:20.477317 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.477278    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/103cfaa4-2fb0-4900-82d5-3afa262e75e1-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:20.798621 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.798507    2550 generic.go:356] "Generic (PLEG): container finished" podID="103cfaa4-2fb0-4900-82d5-3afa262e75e1" containerID="ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283" exitCode=0
Jul 02 17:49:20.798776 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.798661    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc" event={"ID":"103cfaa4-2fb0-4900-82d5-3afa262e75e1","Type":"ContainerDied","Data":"ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283"}
Jul 02 17:49:20.798776 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.798711    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc" event={"ID":"103cfaa4-2fb0-4900-82d5-3afa262e75e1","Type":"ContainerDied","Data":"1ab22cfdc3a08521bf9a2d1c55d12a453fb141d1f72e74b8cf59616b27e23e79"}
Jul 02 17:49:20.798776 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.798740    2550 scope.go:117] "RemoveContainer" containerID="ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283"
Jul 02 17:49:20.798922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.798827    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"
Jul 02 17:49:20.809215 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.809187    2550 scope.go:117] "RemoveContainer" containerID="ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283"
Jul 02 17:49:20.809509 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:49:20.809489    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283\": container with ID starting with ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283 not found: ID does not exist" containerID="ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283"
Jul 02 17:49:20.809584 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.809518    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283"} err="failed to get container status \"ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283\": rpc error: code = NotFound desc = could not find container \"ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283\": container with ID starting with ebf660e8e6062ae6dfb41a5ce9499d4c92aea9eb2933424d50e2546e4f304283 not found: ID does not exist"
Jul 02 17:49:20.821162 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.821133    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"]
Jul 02 17:49:20.825253 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:20.825223    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9dc1ed-597d7476c5-455fc"]
Jul 02 17:49:21.109772 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:21.109691    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:49:21.110115 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:21.110098    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:49:21.110808 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:21.110785    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:49:21.456293 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:21.456258    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="103cfaa4-2fb0-4900-82d5-3afa262e75e1" path="/var/lib/kubelet/pods/103cfaa4-2fb0-4900-82d5-3afa262e75e1/volumes"
Jul 02 17:49:21.754827 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:21.754741    2550 patch_prober.go:28] interesting pod/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 17:49:21.754978 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:21.754843    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 17:49:22.811538 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:22.811506    2550 generic.go:356] "Generic (PLEG): container finished" podID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerID="c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5" exitCode=0
Jul 02 17:49:22.812015 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:22.811613    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" event={"ID":"01773f11-b594-49d4-a48c-ee6fd9a911cd","Type":"ContainerDied","Data":"c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5"}
Jul 02 17:49:22.812201 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:22.812186    2550 scope.go:117] "RemoveContainer" containerID="c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5"
Jul 02 17:49:22.813157 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:22.813128    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:22.813263 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:22.813195    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:22.813263 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:22.813230    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:23.821964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:23.821927    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" event={"ID":"01773f11-b594-49d4-a48c-ee6fd9a911cd","Type":"ContainerStarted","Data":"bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623"}
Jul 02 17:49:24.140703 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:24.140658    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:24.140912 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:24.140890    2550 patch_prober.go:28] interesting pod/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 02 17:49:24.140958 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:24.140937    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 02 17:49:25.140533 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:25.140497    2550 patch_prober.go:28] interesting pod/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 02 17:49:25.140940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:25.140550    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 02 17:49:25.467946 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:25.467862    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"]
Jul 02 17:49:25.468095 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:25.468054    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy" containerID="cri-o://ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753" gracePeriod=30
Jul 02 17:49:26.140967 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:26.140925    2550 patch_prober.go:28] interesting pod/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 02 17:49:26.141359 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:26.140994    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 02 17:49:27.141000 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:27.140958    2550 patch_prober.go:28] interesting pod/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 02 17:49:27.141398 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:27.141016    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 02 17:49:28.144192 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:28.144158    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:28.144579 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:28.144494    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:28.145224 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:28.145208    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:30.725627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.725601    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:49:30.780491 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780407    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b289e7f-845b-49d5-8a79-b50b8d953efe-istiod-ca-cert\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.780491 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780450    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-credential-socket\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.780491 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780474    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-socket\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.780797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780503    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-envoy\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.780797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780565    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-podinfo\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.780797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780619    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-certs\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.780797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780652    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-data\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.780797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780670    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmbqw\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-kube-api-access-bmbqw\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.780797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780693    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-token\") pod \"8b289e7f-845b-49d5-8a79-b50b8d953efe\" (UID: \"8b289e7f-845b-49d5-8a79-b50b8d953efe\") "
Jul 02 17:49:30.781124 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780807    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:30.781124 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780821    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:30.781124 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780973    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b289e7f-845b-49d5-8a79-b50b8d953efe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:49:30.781124 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.780999    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.781124 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.781018    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.781398 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.781246    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:30.781550 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.781523    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:30.782981 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.782955    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:49:30.783107 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.782982    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:49:30.783259 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.783239    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:30.783322 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.783242    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-kube-api-access-bmbqw" (OuterVolumeSpecName: "kube-api-access-bmbqw") pod "8b289e7f-845b-49d5-8a79-b50b8d953efe" (UID: "8b289e7f-845b-49d5-8a79-b50b8d953efe"). InnerVolumeSpecName "kube-api-access-bmbqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:49:30.858100 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.858069    2550 generic.go:356] "Generic (PLEG): container finished" podID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerID="ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753" exitCode=0
Jul 02 17:49:30.858283 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.858114    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"
Jul 02 17:49:30.858283 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.858134    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" event={"ID":"8b289e7f-845b-49d5-8a79-b50b8d953efe","Type":"ContainerDied","Data":"ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753"}
Jul 02 17:49:30.858283 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.858178    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4" event={"ID":"8b289e7f-845b-49d5-8a79-b50b8d953efe","Type":"ContainerDied","Data":"e007ab2e236cdcb39d9a262a7e078db6137b7aa64237c1a2aba8611bd7c64894"}
Jul 02 17:49:30.858283 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.858205    2550 scope.go:117] "RemoveContainer" containerID="ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753"
Jul 02 17:49:30.867460 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.867441    2550 scope.go:117] "RemoveContainer" containerID="e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e"
Jul 02 17:49:30.875938 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.875916    2550 scope.go:117] "RemoveContainer" containerID="ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753"
Jul 02 17:49:30.876299 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:49:30.876246    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753\": container with ID starting with ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753 not found: ID does not exist" containerID="ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753"
Jul 02 17:49:30.876299 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.876277    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753"} err="failed to get container status \"ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753\": rpc error: code = NotFound desc = could not find container \"ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753\": container with ID starting with ea9e34fc6de2463309e7f5242a2ebeb1fdb1f16763e984fc6fb3daf946acc753 not found: ID does not exist"
Jul 02 17:49:30.876299 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.876296    2550 scope.go:117] "RemoveContainer" containerID="e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e"
Jul 02 17:49:30.876666 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:49:30.876635    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e\": container with ID starting with e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e not found: ID does not exist" containerID="e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e"
Jul 02 17:49:30.876789 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.876674    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e"} err="failed to get container status \"e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e\": rpc error: code = NotFound desc = could not find container \"e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e\": container with ID starting with e0545ab2bdb40da29f5c666139d6341eb59a4cdb9181b7a9e00dc58d949c229e not found: ID does not exist"
Jul 02 17:49:30.879097 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.879072    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"]
Jul 02 17:49:30.882013 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.881989    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.882129 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.882017    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmbqw\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-kube-api-access-bmbqw\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.882129 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.882031    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.882129 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.882046    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b289e7f-845b-49d5-8a79-b50b8d953efe-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.882129 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.882058    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.882129 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.882071    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b289e7f-845b-49d5-8a79-b50b8d953efe-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.882129 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.882084    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b289e7f-845b-49d5-8a79-b50b8d953efe-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:30.883091 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:30.883069    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9dc1ed-openshift-default-6d766c955f-wngx4"]
Jul 02 17:49:31.454119 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:31.454083    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" path="/var/lib/kubelet/pods/8b289e7f-845b-49d5-8a79-b50b8d953efe/volumes"
Jul 02 17:49:32.158786 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:32.158741    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"]
Jul 02 17:49:32.159414 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:32.159372    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy" containerID="cri-o://bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623" gracePeriod=30
Jul 02 17:49:33.051123 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051089    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"]
Jul 02 17:49:33.051449 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051437    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy"
Jul 02 17:49:33.051449 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051451    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy"
Jul 02 17:49:33.051533 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051457    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103cfaa4-2fb0-4900-82d5-3afa262e75e1" containerName="maas-api"
Jul 02 17:49:33.051533 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051463    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="103cfaa4-2fb0-4900-82d5-3afa262e75e1" containerName="maas-api"
Jul 02 17:49:33.051533 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051486    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy"
Jul 02 17:49:33.051533 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051492    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy"
Jul 02 17:49:33.051691 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051544    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy"
Jul 02 17:49:33.051691 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.051554    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="103cfaa4-2fb0-4900-82d5-3afa262e75e1" containerName="maas-api"
Jul 02 17:49:33.054556 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.054540    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.056920 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.056903    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-1381a9-openshift-default-dockercfg-9cb4x\""
Jul 02 17:49:33.072359 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.072332    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"]
Jul 02 17:49:33.100586 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100540    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-certs\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.100784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100646    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-credential-socket\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.100784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100680    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istiod-ca-cert\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.100784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100713    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-envoy\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.100784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100744    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-socket\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.100784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100773    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-data\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.100964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100837    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-podinfo\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.100964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100928    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-token\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.101030 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.100957    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dbbt\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-kube-api-access-9dbbt\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202052 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202010    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-token\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202052 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202051    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dbbt\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-kube-api-access-9dbbt\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202074    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-certs\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202111    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-credential-socket\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202237    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istiod-ca-cert\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202284    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-envoy\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202315    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-socket\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202342    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-data\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202400    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-podinfo\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202500    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-credential-socket\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202632 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202583    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-certs\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202946 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202709    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-socket\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.202946 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202766    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-data\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.203014 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.202943    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istiod-ca-cert\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.204782 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.204759    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-envoy\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.204982 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.204966    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-podinfo\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.209627 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.209586    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-token\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.209732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.209689    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dbbt\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-kube-api-access-9dbbt\") pod \"e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") " pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.364688 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.364658    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:33.516973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.516942    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"]
Jul 02 17:49:33.518625 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:49:33.518586    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2083f1_dfa7_4e28_8be0_0a4d302dd1c6.slice/crio-9daf9c1d0353c402924e5826ba7fba8cb11b51af3c7b17a37c1f643883fb360a WatchSource:0}: Error finding container 9daf9c1d0353c402924e5826ba7fba8cb11b51af3c7b17a37c1f643883fb360a: Status 404 returned error can't find the container with id 9daf9c1d0353c402924e5826ba7fba8cb11b51af3c7b17a37c1f643883fb360a
Jul 02 17:49:33.521266 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.521237    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:33.521346 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.521298    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:33.521346 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.521325    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:33.874873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.874841    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" event={"ID":"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6","Type":"ContainerStarted","Data":"24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4"}
Jul 02 17:49:33.875072 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.874890    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" event={"ID":"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6","Type":"ContainerStarted","Data":"9daf9c1d0353c402924e5826ba7fba8cb11b51af3c7b17a37c1f643883fb360a"}
Jul 02 17:49:33.893950 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:33.893901    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" podStartSLOduration=1.893884403 podStartE2EDuration="1.893884403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:49:33.891338807 +0000 UTC m=+2328.882299062" watchObservedRunningTime="2026-07-02 17:49:33.893884403 +0000 UTC m=+2328.884844708"
Jul 02 17:49:34.365508 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:34.365482    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:34.370762 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:34.370736    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:34.879824 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:34.879796    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:34.880744 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:34.880717    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:35.816526 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:35.816497    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"]
Jul 02 17:49:35.816996 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:35.816978    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b289e7f-845b-49d5-8a79-b50b8d953efe" containerName="istio-proxy"
Jul 02 17:49:35.820879 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:35.820852    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:35.822797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:35.822776    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-1381a9-serving-cert\""
Jul 02 17:49:35.828584 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:35.828558    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"]
Jul 02 17:49:35.929896 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:35.929860    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdx4l\" (UniqueName: \"kubernetes.io/projected/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-kube-api-access-sdx4l\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:35.930197 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:35.930158    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-maas-api-tls\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:35.930322 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:35.930204    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:36.031515 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.031482    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdx4l\" (UniqueName: \"kubernetes.io/projected/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-kube-api-access-sdx4l\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:36.031728 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.031525    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-maas-api-tls\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:36.031728 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.031558    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:36.032249 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.032227    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:36.034108 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.034085    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-maas-api-tls\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:36.038692 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.038669    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdx4l\" (UniqueName: \"kubernetes.io/projected/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-kube-api-access-sdx4l\") pod \"maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") " pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:36.134226 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.134192    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:36.269890 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.269862    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"]
Jul 02 17:49:36.272816 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:49:36.272788    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773c11b4_bf4b_46d6_8e9a_63b471e2a3a3.slice/crio-3af212b18ad58f17efd549206f87ef9d9b8740bf326925d4d6f9caa2da421d50 WatchSource:0}: Error finding container 3af212b18ad58f17efd549206f87ef9d9b8740bf326925d4d6f9caa2da421d50: Status 404 returned error can't find the container with id 3af212b18ad58f17efd549206f87ef9d9b8740bf326925d4d6f9caa2da421d50
Jul 02 17:49:36.891649 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.891528    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj" event={"ID":"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3","Type":"ContainerStarted","Data":"e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131"}
Jul 02 17:49:36.891649 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.891632    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj" event={"ID":"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3","Type":"ContainerStarted","Data":"3af212b18ad58f17efd549206f87ef9d9b8740bf326925d4d6f9caa2da421d50"}
Jul 02 17:49:36.909382 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:36.909330    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj" podStartSLOduration=1.556639415 podStartE2EDuration="1.909314613s" totalImagesPullingTime="352.675198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:49:36.907965902 +0000 UTC m=+2331.898926182" watchObservedRunningTime="2026-07-02 17:49:36.909314613 +0000 UTC m=+2331.900274868"
Jul 02 17:49:37.440617 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.440571    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:37.544863 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.544833    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-credential-socket\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545064 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.544947    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-token\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545064 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.544986    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-socket\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545064 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545007    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-certs\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545064 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545036    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-envoy\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545064 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545063    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-data\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545320 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545109    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01773f11-b594-49d4-a48c-ee6fd9a911cd-istiod-ca-cert\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545320 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545111    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:37.545320 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545140    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j42c\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-kube-api-access-9j42c\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545320 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545196    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-podinfo\") pod \"01773f11-b594-49d4-a48c-ee6fd9a911cd\" (UID: \"01773f11-b594-49d4-a48c-ee6fd9a911cd\") "
Jul 02 17:49:37.545506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545342    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:37.545506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545326    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:37.545506 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545489    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01773f11-b594-49d4-a48c-ee6fd9a911cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:49:37.545752 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545731    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.545838 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545760    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.545838 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545775    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.545838 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.545791    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01773f11-b594-49d4-a48c-ee6fd9a911cd-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.546318 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.546300    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:37.547744 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.547716    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:49:37.547744 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.547729    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:49:37.547876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.547808    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:49:37.547876 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.547851    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-kube-api-access-9j42c" (OuterVolumeSpecName: "kube-api-access-9j42c") pod "01773f11-b594-49d4-a48c-ee6fd9a911cd" (UID: "01773f11-b594-49d4-a48c-ee6fd9a911cd"). InnerVolumeSpecName "kube-api-access-9j42c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:49:37.647153 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.647107    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.647153 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.647148    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.647153 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.647157    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.647153 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.647165    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j42c\" (UniqueName: \"kubernetes.io/projected/01773f11-b594-49d4-a48c-ee6fd9a911cd-kube-api-access-9j42c\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.647153 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.647174    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01773f11-b594-49d4-a48c-ee6fd9a911cd-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:49:37.897551 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.897514    2550 generic.go:356] "Generic (PLEG): container finished" podID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerID="bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623" exitCode=0
Jul 02 17:49:37.898093 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.897549    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" event={"ID":"01773f11-b594-49d4-a48c-ee6fd9a911cd","Type":"ContainerDied","Data":"bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623"}
Jul 02 17:49:37.898093 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.897575    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"
Jul 02 17:49:37.898093 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.897646    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz" event={"ID":"01773f11-b594-49d4-a48c-ee6fd9a911cd","Type":"ContainerDied","Data":"c27b29a7b54410529d9aeb8b997f1bbb5e53fb39d32d1ba37b5176e61d6328c0"}
Jul 02 17:49:37.898093 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.897680    2550 scope.go:117] "RemoveContainer" containerID="bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623"
Jul 02 17:49:37.898093 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.897990    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:37.906410 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.906394    2550 scope.go:117] "RemoveContainer" containerID="c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5"
Jul 02 17:49:37.914212 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.914190    2550 scope.go:117] "RemoveContainer" containerID="bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623"
Jul 02 17:49:37.914454 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:49:37.914437    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623\": container with ID starting with bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623 not found: ID does not exist" containerID="bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623"
Jul 02 17:49:37.914509 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.914463    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623"} err="failed to get container status \"bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623\": rpc error: code = NotFound desc = could not find container \"bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623\": container with ID starting with bf6ab90e673b60e22d2f4e7ad979d3a02cdc8ff880eb0f41a7963fa907d5a623 not found: ID does not exist"
Jul 02 17:49:37.914509 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.914479    2550 scope.go:117] "RemoveContainer" containerID="c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5"
Jul 02 17:49:37.914727 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:49:37.914704    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5\": container with ID starting with c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5 not found: ID does not exist" containerID="c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5"
Jul 02 17:49:37.914792 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.914736    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5"} err="failed to get container status \"c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5\": rpc error: code = NotFound desc = could not find container \"c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5\": container with ID starting with c25dd2076f7cd167a45411e8e35f99b1983747704dc24558f0f4cd4216a9e3e5 not found: ID does not exist"
Jul 02 17:49:37.918553 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.918529    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"]
Jul 02 17:49:37.921805 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:37.921784    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1b97a7-openshift-default-7bdd854d47-6qcxz"]
Jul 02 17:49:39.455463 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:39.455429    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" path="/var/lib/kubelet/pods/01773f11-b594-49d4-a48c-ee6fd9a911cd/volumes"
Jul 02 17:49:40.829365 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.829325    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"]
Jul 02 17:49:40.829841 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.829818    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy"
Jul 02 17:49:40.829841 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.829833    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy"
Jul 02 17:49:40.829979 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.829921    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy"
Jul 02 17:49:40.829979 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.829934    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy"
Jul 02 17:49:40.831974 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.831958    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.834612 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.834571    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d1bf18-openshift-default-dockercfg-qbcc2\""
Jul 02 17:49:40.844185 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.844162    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"]
Jul 02 17:49:40.876769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.876732    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istiod-ca-cert\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.876769 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.876772    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-credential-socket\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.876980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.876837    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-token\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.876980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.876861    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-envoy\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.876980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.876877    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-podinfo\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.876980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.876897    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vdv7\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-kube-api-access-6vdv7\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.876980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.876931    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-certs\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.877148 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.876987    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-socket\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.877148 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.877020    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-data\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978428 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978389    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-token\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978428 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978432    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-envoy\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978451    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-podinfo\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978471    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vdv7\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-kube-api-access-6vdv7\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978517    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-certs\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978544    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-socket\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978561    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-data\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978653    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istiod-ca-cert\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.978731 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978690    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-credential-socket\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.979081 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978929    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-socket\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.979081 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.978958    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-certs\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.979081 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.979009    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-data\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.979230 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.979168    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-credential-socket\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.979329 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.979305    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istiod-ca-cert\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.980897 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.980872    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-envoy\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.981048 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.981033    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-podinfo\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.986556 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.986528    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-token\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:40.986751 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:40.986731    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vdv7\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-kube-api-access-6vdv7\") pod \"e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") " pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:41.142901 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:41.142858    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:41.277184 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:41.277151    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"]
Jul 02 17:49:41.278496 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:49:41.278471    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc06e49a_3075_4a6e_9cd5_7853695b6feb.slice/crio-9000a13898c4039402e12b8fae0151ed467bfd6fea8bfa051ea9609185bc1659 WatchSource:0}: Error finding container 9000a13898c4039402e12b8fae0151ed467bfd6fea8bfa051ea9609185bc1659: Status 404 returned error can't find the container with id 9000a13898c4039402e12b8fae0151ed467bfd6fea8bfa051ea9609185bc1659
Jul 02 17:49:41.281155 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:41.281122    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:41.281240 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:41.281198    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:41.281240 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:41.281229    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:41.918814 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:41.918774    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" event={"ID":"fc06e49a-3075-4a6e-9cd5-7853695b6feb","Type":"ContainerStarted","Data":"f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6"}
Jul 02 17:49:41.919311 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:41.918853    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" event={"ID":"fc06e49a-3075-4a6e-9cd5-7853695b6feb","Type":"ContainerStarted","Data":"9000a13898c4039402e12b8fae0151ed467bfd6fea8bfa051ea9609185bc1659"}
Jul 02 17:49:41.939063 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:41.938504    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" podStartSLOduration=1.9384834309999999 podStartE2EDuration="1.938483431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:49:41.937793897 +0000 UTC m=+2336.928754151" watchObservedRunningTime="2026-07-02 17:49:41.938483431 +0000 UTC m=+2336.929443739"
Jul 02 17:49:42.144085 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:42.144044    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:42.149167 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:42.149143    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:42.923447 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:42.923414    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:42.924320 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:42.924302    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:49:43.887469 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:43.887432    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"]
Jul 02 17:49:43.887873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:43.887849    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy"
Jul 02 17:49:43.887873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:43.887868    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="01773f11-b594-49d4-a48c-ee6fd9a911cd" containerName="istio-proxy"
Jul 02 17:49:43.890404 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:43.890379    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:43.892191 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:43.892170    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-d1bf18-serving-cert\""
Jul 02 17:49:43.902197 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:43.902169    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"]
Jul 02 17:49:43.909200 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:43.909180    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:49:44.008944 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.008911    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71e8a57a-6040-4674-985e-7f044103dd8a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.009436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.009022    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9xbl\" (UniqueName: \"kubernetes.io/projected/71e8a57a-6040-4674-985e-7f044103dd8a-kube-api-access-d9xbl\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.009436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.009386    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e8a57a-6040-4674-985e-7f044103dd8a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.110013 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.109974    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71e8a57a-6040-4674-985e-7f044103dd8a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.110204 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.110031    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9xbl\" (UniqueName: \"kubernetes.io/projected/71e8a57a-6040-4674-985e-7f044103dd8a-kube-api-access-d9xbl\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.110204 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.110099    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e8a57a-6040-4674-985e-7f044103dd8a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.111000 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.110975    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e8a57a-6040-4674-985e-7f044103dd8a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.112700 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.112679    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71e8a57a-6040-4674-985e-7f044103dd8a-maas-api-tls\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.118290 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.118262    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9xbl\" (UniqueName: \"kubernetes.io/projected/71e8a57a-6040-4674-985e-7f044103dd8a-kube-api-access-d9xbl\") pod \"maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") " pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.203176 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.203089    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.353946 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.353920    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"]
Jul 02 17:49:44.356237 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:49:44.356209    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e8a57a_6040_4674_985e_7f044103dd8a.slice/crio-93f577bd2a49c0e33ca352d9c268dca14e9b06cc95582397b75937f6f82e5284 WatchSource:0}: Error finding container 93f577bd2a49c0e33ca352d9c268dca14e9b06cc95582397b75937f6f82e5284: Status 404 returned error can't find the container with id 93f577bd2a49c0e33ca352d9c268dca14e9b06cc95582397b75937f6f82e5284
Jul 02 17:49:44.934689 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.934644    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm" event={"ID":"71e8a57a-6040-4674-985e-7f044103dd8a","Type":"ContainerStarted","Data":"4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f"}
Jul 02 17:49:44.934899 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.934723    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm" event={"ID":"71e8a57a-6040-4674-985e-7f044103dd8a","Type":"ContainerStarted","Data":"93f577bd2a49c0e33ca352d9c268dca14e9b06cc95582397b75937f6f82e5284"}
Jul 02 17:49:44.934964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.934948    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:44.952420 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:44.952353    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm" podStartSLOduration=1.604560553 podStartE2EDuration="1.95233178s" totalImagesPullingTime="347.771227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 17:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:49:44.951613743 +0000 UTC m=+2339.942574004" watchObservedRunningTime="2026-07-02 17:49:44.95233178 +0000 UTC m=+2339.943292035"
Jul 02 17:49:50.921917 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:50.921839    2550 patch_prober.go:28] interesting pod/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 17:49:50.922980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:50.922676    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 17:49:50.945745 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:50.945711    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:49:51.971118 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:51.971084    2550 generic.go:356] "Generic (PLEG): container finished" podID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerID="24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4" exitCode=0
Jul 02 17:49:51.971554 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:51.971132    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" event={"ID":"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6","Type":"ContainerDied","Data":"24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4"}
Jul 02 17:49:51.971554 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:51.971541    2550 scope.go:117] "RemoveContainer" containerID="24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4"
Jul 02 17:49:51.972687 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:51.972651    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:51.972804 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:51.972749    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:51.972804 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:51.972795    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:52.977787 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:52.977754    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" event={"ID":"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6","Type":"ContainerStarted","Data":"e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94"}
Jul 02 17:49:53.365194 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:53.365157    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:53.365521 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:53.365420    2550 patch_prober.go:28] interesting pod/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 02 17:49:53.365521 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:53.365476    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 02 17:49:54.365355 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:54.365317    2550 patch_prober.go:28] interesting pod/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 02 17:49:54.365846 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:54.365403    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 02 17:49:55.365953 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:55.365913    2550 patch_prober.go:28] interesting pod/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 02 17:49:55.366448 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:55.365973    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 02 17:49:56.365138 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:56.365100    2550 patch_prober.go:28] interesting pod/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 02 17:49:56.365323 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:56.365156    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 02 17:49:57.369267 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:57.369236    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:57.369820 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:57.369527    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:57.370299 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:57.370284    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:49:58.329084 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:58.329055    2550 patch_prober.go:28] interesting pod/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:42486->10.134.0.49:15021: read: connection reset by peer" start-of-body=
Jul 02 17:49:58.329208 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:58.329144    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:42486->10.134.0.49:15021: read: connection reset by peer"
Jul 02 17:49:59.010377 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:59.010345    2550 generic.go:356] "Generic (PLEG): container finished" podID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerID="f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6" exitCode=0
Jul 02 17:49:59.010781 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:59.010422    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" event={"ID":"fc06e49a-3075-4a6e-9cd5-7853695b6feb","Type":"ContainerDied","Data":"f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6"}
Jul 02 17:49:59.010990 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:59.010970    2550 scope.go:117] "RemoveContainer" containerID="f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6"
Jul 02 17:49:59.011945 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:59.011920    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:59.012008 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:59.011986    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:49:59.012046 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:49:59.012016    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 17:50:00.020083 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:00.020044    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" event={"ID":"fc06e49a-3075-4a6e-9cd5-7853695b6feb","Type":"ContainerStarted","Data":"cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c"}
Jul 02 17:50:00.143860 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:00.143819    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:50:00.144088 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:00.144066    2550 patch_prober.go:28] interesting pod/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 02 17:50:00.144150 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:00.144130    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 02 17:50:01.143723 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:01.143681    2550 patch_prober.go:28] interesting pod/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 02 17:50:01.144100 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:01.143740    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 02 17:50:02.143454 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:02.143415    2550 patch_prober.go:28] interesting pod/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 02 17:50:02.143670 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:02.143504    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 02 17:50:03.143825 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:03.143786    2550 patch_prober.go:28] interesting pod/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 02 17:50:03.144238 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:03.143845    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 02 17:50:04.143338 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:04.143293    2550 patch_prober.go:28] interesting pod/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Jul 02 17:50:04.143515 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:04.143355    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Jul 02 17:50:05.147524 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:05.147495    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:50:05.147913 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:05.147785    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:50:05.148571 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:05.148549    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:50:45.634137 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:45.634103    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:50:45.640061 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:50:45.640033    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:55:45.673628 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:55:45.673526    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:55:45.679824 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:55:45.679805    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:57:00.090687 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.090652    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"]
Jul 02 17:57:00.091264 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.090952    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj" podUID="773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" containerName="maas-api" containerID="cri-o://e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131" gracePeriod=30
Jul 02 17:57:00.348078 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.348014    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:57:00.401309 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.401276    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-maas-api-tls\") pod \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") "
Jul 02 17:57:00.401482 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.401363    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-openshift-service-ca\") pod \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") "
Jul 02 17:57:00.401576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.401551    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdx4l\" (UniqueName: \"kubernetes.io/projected/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-kube-api-access-sdx4l\") pod \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\" (UID: \"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3\") "
Jul 02 17:57:00.401723 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.401701    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" (UID: "773c11b4-bf4b-46d6-8e9a-63b471e2a3a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:57:00.401897 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.401880    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:00.403474 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.403443    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" (UID: "773c11b4-bf4b-46d6-8e9a-63b471e2a3a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:57:00.403619 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.403550    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-kube-api-access-sdx4l" (OuterVolumeSpecName: "kube-api-access-sdx4l") pod "773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" (UID: "773c11b4-bf4b-46d6-8e9a-63b471e2a3a3"). InnerVolumeSpecName "kube-api-access-sdx4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:57:00.503038 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.502999    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdx4l\" (UniqueName: \"kubernetes.io/projected/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-kube-api-access-sdx4l\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:00.503038 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:00.503031    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:01.060980 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.060942    2550 generic.go:356] "Generic (PLEG): container finished" podID="773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" containerID="e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131" exitCode=0
Jul 02 17:57:01.061159 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.060988    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"
Jul 02 17:57:01.061159 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.061029    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj" event={"ID":"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3","Type":"ContainerDied","Data":"e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131"}
Jul 02 17:57:01.061159 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.061084    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj" event={"ID":"773c11b4-bf4b-46d6-8e9a-63b471e2a3a3","Type":"ContainerDied","Data":"3af212b18ad58f17efd549206f87ef9d9b8740bf326925d4d6f9caa2da421d50"}
Jul 02 17:57:01.061159 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.061106    2550 scope.go:117] "RemoveContainer" containerID="e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131"
Jul 02 17:57:01.070499 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.070479    2550 scope.go:117] "RemoveContainer" containerID="e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131"
Jul 02 17:57:01.070776 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:57:01.070755    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131\": container with ID starting with e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131 not found: ID does not exist" containerID="e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131"
Jul 02 17:57:01.070830 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.070784    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131"} err="failed to get container status \"e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131\": rpc error: code = NotFound desc = could not find container \"e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131\": container with ID starting with e4d28fcd6cdafa4953cdb7f1afb0fa76619ef2fc178fe961d779c0dedb258131 not found: ID does not exist"
Jul 02 17:57:01.084844 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.084816    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"]
Jul 02 17:57:01.089517 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.089495    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-1381a9-767c6fc99c-rnhpj"]
Jul 02 17:57:01.455304 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:01.455270    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" path="/var/lib/kubelet/pods/773c11b4-bf4b-46d6-8e9a-63b471e2a3a3/volumes"
Jul 02 17:57:06.545351 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:06.545276    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"]
Jul 02 17:57:06.545874 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:06.545525    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy" containerID="cri-o://e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94" gracePeriod=30
Jul 02 17:57:07.794561 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:07.794527    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"]
Jul 02 17:57:07.795047 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:07.794764    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm" podUID="71e8a57a-6040-4674-985e-7f044103dd8a" containerName="maas-api" containerID="cri-o://4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f" gracePeriod=30
Jul 02 17:57:08.048729 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.048658    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:57:08.074909 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.074876    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9xbl\" (UniqueName: \"kubernetes.io/projected/71e8a57a-6040-4674-985e-7f044103dd8a-kube-api-access-d9xbl\") pod \"71e8a57a-6040-4674-985e-7f044103dd8a\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") "
Jul 02 17:57:08.075099 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.075011    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e8a57a-6040-4674-985e-7f044103dd8a-openshift-service-ca\") pod \"71e8a57a-6040-4674-985e-7f044103dd8a\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") "
Jul 02 17:57:08.075099 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.075059    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71e8a57a-6040-4674-985e-7f044103dd8a-maas-api-tls\") pod \"71e8a57a-6040-4674-985e-7f044103dd8a\" (UID: \"71e8a57a-6040-4674-985e-7f044103dd8a\") "
Jul 02 17:57:08.075641 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.075608    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71e8a57a-6040-4674-985e-7f044103dd8a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71e8a57a-6040-4674-985e-7f044103dd8a" (UID: "71e8a57a-6040-4674-985e-7f044103dd8a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:57:08.077663 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.077636    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71e8a57a-6040-4674-985e-7f044103dd8a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71e8a57a-6040-4674-985e-7f044103dd8a" (UID: "71e8a57a-6040-4674-985e-7f044103dd8a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 17:57:08.077830 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.077809    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71e8a57a-6040-4674-985e-7f044103dd8a-kube-api-access-d9xbl" (OuterVolumeSpecName: "kube-api-access-d9xbl") pod "71e8a57a-6040-4674-985e-7f044103dd8a" (UID: "71e8a57a-6040-4674-985e-7f044103dd8a"). InnerVolumeSpecName "kube-api-access-d9xbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:57:08.098355 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.098322    2550 generic.go:356] "Generic (PLEG): container finished" podID="71e8a57a-6040-4674-985e-7f044103dd8a" containerID="4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f" exitCode=0
Jul 02 17:57:08.098547 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.098377    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"
Jul 02 17:57:08.098547 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.098417    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm" event={"ID":"71e8a57a-6040-4674-985e-7f044103dd8a","Type":"ContainerDied","Data":"4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f"}
Jul 02 17:57:08.098547 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.098470    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm" event={"ID":"71e8a57a-6040-4674-985e-7f044103dd8a","Type":"ContainerDied","Data":"93f577bd2a49c0e33ca352d9c268dca14e9b06cc95582397b75937f6f82e5284"}
Jul 02 17:57:08.098547 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.098499    2550 scope.go:117] "RemoveContainer" containerID="4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f"
Jul 02 17:57:08.107873 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.107851    2550 scope.go:117] "RemoveContainer" containerID="4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f"
Jul 02 17:57:08.108196 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:57:08.108173    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f\": container with ID starting with 4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f not found: ID does not exist" containerID="4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f"
Jul 02 17:57:08.108273 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.108211    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f"} err="failed to get container status \"4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f\": rpc error: code = NotFound desc = could not find container \"4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f\": container with ID starting with 4d10b7d796a42713aa4517195d4f3cf168abecd82665b0314fdbc1d41a038d9f not found: ID does not exist"
Jul 02 17:57:08.120419 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.120392    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"]
Jul 02 17:57:08.124046 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.124020    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-d1bf18-54786dbc85-dpjcm"]
Jul 02 17:57:08.176789 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.176750    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71e8a57a-6040-4674-985e-7f044103dd8a-openshift-service-ca\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:08.176789 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.176783    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71e8a57a-6040-4674-985e-7f044103dd8a-maas-api-tls\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:08.176789 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:08.176794    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9xbl\" (UniqueName: \"kubernetes.io/projected/71e8a57a-6040-4674-985e-7f044103dd8a-kube-api-access-d9xbl\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:09.454336 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:09.454298    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71e8a57a-6040-4674-985e-7f044103dd8a" path="/var/lib/kubelet/pods/71e8a57a-6040-4674-985e-7f044103dd8a/volumes"
Jul 02 17:57:11.798060 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.798028    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:57:11.913235 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913199    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dbbt\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-kube-api-access-9dbbt\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913434 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913325    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-certs\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913434 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913349    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-credential-socket\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913434 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913377    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-socket\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913434 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913397    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-data\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913434 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913414    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-podinfo\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913451    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istiod-ca-cert\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913474    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-envoy\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913554    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-token\") pod \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\" (UID: \"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6\") "
Jul 02 17:57:11.913734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913704    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:11.913734 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913715    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:11.913997 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913732    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:11.913997 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913963    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:11.913997 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.913984    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:11.914127 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.914002    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:11.914201 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.914179    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:57:11.914464 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.914438    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:11.915821 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.915802    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:57:11.915917 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.915848    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:57:11.915973 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.915935    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-kube-api-access-9dbbt" (OuterVolumeSpecName: "kube-api-access-9dbbt") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "kube-api-access-9dbbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:57:11.916013 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:11.915982    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" (UID: "ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:12.015413 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.015377    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:12.015413 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.015407    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dbbt\" (UniqueName: \"kubernetes.io/projected/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-kube-api-access-9dbbt\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:12.015413 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.015418    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:12.015678 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.015427    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:12.015678 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.015436    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:12.015678 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.015448    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:12.119965 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.119923    2550 generic.go:356] "Generic (PLEG): container finished" podID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerID="e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94" exitCode=0
Jul 02 17:57:12.120224 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.120002    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" event={"ID":"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6","Type":"ContainerDied","Data":"e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94"}
Jul 02 17:57:12.120224 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.120024    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"
Jul 02 17:57:12.120224 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.120062    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n" event={"ID":"ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6","Type":"ContainerDied","Data":"9daf9c1d0353c402924e5826ba7fba8cb11b51af3c7b17a37c1f643883fb360a"}
Jul 02 17:57:12.120224 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.120096    2550 scope.go:117] "RemoveContainer" containerID="e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94"
Jul 02 17:57:12.130060 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.130040    2550 scope.go:117] "RemoveContainer" containerID="24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4"
Jul 02 17:57:12.141880 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.141855    2550 scope.go:117] "RemoveContainer" containerID="e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94"
Jul 02 17:57:12.142242 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:57:12.142214    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94\": container with ID starting with e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94 not found: ID does not exist" containerID="e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94"
Jul 02 17:57:12.142326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.142254    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94"} err="failed to get container status \"e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94\": rpc error: code = NotFound desc = could not find container \"e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94\": container with ID starting with e25b27b54eb24bf4876cd97bc20d13d424f194f5b3d049206191c7dda31b9e94 not found: ID does not exist"
Jul 02 17:57:12.142326 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.142278    2550 scope.go:117] "RemoveContainer" containerID="24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4"
Jul 02 17:57:12.142679 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:57:12.142654    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4\": container with ID starting with 24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4 not found: ID does not exist" containerID="24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4"
Jul 02 17:57:12.142740 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.142692    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4"} err="failed to get container status \"24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4\": rpc error: code = NotFound desc = could not find container \"24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4\": container with ID starting with 24fd3b5ca139a3c140497ff3c3b8e4d5a1bf894d6d1f26e2ab2507d6d36eeee4 not found: ID does not exist"
Jul 02 17:57:12.142815 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.142799    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"]
Jul 02 17:57:12.146292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:12.146269    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-1381a9-openshift-default-86b4445659-wrh9n"]
Jul 02 17:57:12.153359 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:57:12.153337    2550 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2083f1_dfa7_4e28_8be0_0a4d302dd1c6.slice/crio-9daf9c1d0353c402924e5826ba7fba8cb11b51af3c7b17a37c1f643883fb360a\": RecentStats: unable to find data in memory cache]"
Jul 02 17:57:13.454843 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:13.454807    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" path="/var/lib/kubelet/pods/ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6/volumes"
Jul 02 17:57:13.888959 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:13.888923    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"]
Jul 02 17:57:14.129468 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:14.129423    2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy" containerID="cri-o://cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c" gracePeriod=30
Jul 02 17:57:19.385898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.385856    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7ff58cd6f4-7rjqh_3a36a944-beb2-439a-b5e1-bc7290106fa6/maas-api/0.log"
Jul 02 17:57:19.396436 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.396378    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:57:19.486165 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486132    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-credential-socket\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486335 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486206    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-podinfo\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486335 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486233    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-token\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486335 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486249    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istiod-ca-cert\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486335 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486288    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-data\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486553 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486411    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:19.486553 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486426    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-socket\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486553 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486469    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vdv7\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-kube-api-access-6vdv7\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486553 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486529    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-envoy\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486865 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486581    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-certs\") pod \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\" (UID: \"fc06e49a-3075-4a6e-9cd5-7853695b6feb\") "
Jul 02 17:57:19.486865 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486689    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:19.486865 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486736    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 17:57:19.487023 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.486898    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:19.487079 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.487056    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-certs\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.487131 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.487076    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-credential-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.487131 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.487091    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istiod-ca-cert\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.487131 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.487105    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-workload-socket\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.487292 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.487130    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:19.488576 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.488548    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 17:57:19.488729 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.488571    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:57:19.488729 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.488587    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-kube-api-access-6vdv7" (OuterVolumeSpecName: "kube-api-access-6vdv7") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "kube-api-access-6vdv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 17:57:19.488813 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.488771    2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc06e49a-3075-4a6e-9cd5-7853695b6feb" (UID: "fc06e49a-3075-4a6e-9cd5-7853695b6feb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 17:57:19.503126 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.503106    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716890-gpc85_4bed1856-b159-4297-b887-0f901bd4e1b9/cleanup/0.log"
Jul 02 17:57:19.587953 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.587923    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vdv7\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-kube-api-access-6vdv7\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.587953 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.587949    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-envoy\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.587953 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.587960    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-podinfo\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.588199 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.587970    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-token\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.588199 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.587978    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc06e49a-3075-4a6e-9cd5-7853695b6feb-istio-data\") on node \"ip-10-0-133-98.ec2.internal\" DevicePath \"\""
Jul 02 17:57:19.743776 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.743697    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85f9dc7b46-fv8tm_5f92d32f-433b-4c85-955e-1f2315dda012/manager/0.log"
Jul 02 17:57:19.854492 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:19.854459    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sjxrr_4e867551-a8e2-491b-bf59-a85af1c5112d/server/0.log"
Jul 02 17:57:20.159171 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.159143    2550 generic.go:356] "Generic (PLEG): container finished" podID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerID="cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c" exitCode=0
Jul 02 17:57:20.159351 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.159196    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"
Jul 02 17:57:20.159351 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.159235    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" event={"ID":"fc06e49a-3075-4a6e-9cd5-7853695b6feb","Type":"ContainerDied","Data":"cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c"}
Jul 02 17:57:20.159351 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.159293    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd" event={"ID":"fc06e49a-3075-4a6e-9cd5-7853695b6feb","Type":"ContainerDied","Data":"9000a13898c4039402e12b8fae0151ed467bfd6fea8bfa051ea9609185bc1659"}
Jul 02 17:57:20.159351 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.159321    2550 scope.go:117] "RemoveContainer" containerID="cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c"
Jul 02 17:57:20.168630 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.168613    2550 scope.go:117] "RemoveContainer" containerID="f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6"
Jul 02 17:57:20.176663 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.176570    2550 scope.go:117] "RemoveContainer" containerID="cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c"
Jul 02 17:57:20.176842 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:57:20.176824    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c\": container with ID starting with cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c not found: ID does not exist" containerID="cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c"
Jul 02 17:57:20.176887 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.176851    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c"} err="failed to get container status \"cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c\": rpc error: code = NotFound desc = could not find container \"cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c\": container with ID starting with cf56f70a270782a9b211505e00917ea80d4c97b6dc9b88434b2b2d7dfbaadc3c not found: ID does not exist"
Jul 02 17:57:20.176887 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.176870    2550 scope.go:117] "RemoveContainer" containerID="f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6"
Jul 02 17:57:20.177133 ip-10-0-133-98 kubenswrapper[2550]: E0702 17:57:20.177115    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6\": container with ID starting with f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6 not found: ID does not exist" containerID="f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6"
Jul 02 17:57:20.177192 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.177138    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6"} err="failed to get container status \"f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6\": rpc error: code = NotFound desc = could not find container \"f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6\": container with ID starting with f8a97e66f4b567b970b8299938329b754ddee06b723ef02b8da7aad2a13a44d6 not found: ID does not exist"
Jul 02 17:57:20.180110 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.180087    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"]
Jul 02 17:57:20.187620 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.187586    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d1bf18-openshift-default-bf5f678c5-xpdpd"]
Jul 02 17:57:20.338356 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.338331    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546844fdf5-rqptz_ed8df491-0627-497f-a42f-2574a394bd0a/copy-manifests/0.log"
Jul 02 17:57:20.345797 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:20.345782    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546844fdf5-rqptz_ed8df491-0627-497f-a42f-2574a394bd0a/manager/0.log"
Jul 02 17:57:21.455376 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:21.455337    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" path="/var/lib/kubelet/pods/fc06e49a-3075-4a6e-9cd5-7853695b6feb/volumes"
Jul 02 17:57:22.906100 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:22.906070    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mhft4_a7e3fcc4-411b-40fa-871a-9f31e47735db/istio-proxy/0.log"
Jul 02 17:57:23.028243 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:23.028199    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sz2dh_af35f710-1037-4ae3-b0ed-ccac8ee798ce/discovery/0.log"
Jul 02 17:57:23.375365 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:23.375337    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pmht6_aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a/istio-proxy/1.log"
Jul 02 17:57:23.494343 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:23.494314    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-s2lsq_8c232206-6448-4bec-b5ca-6799fd576adc/payload-pre-processing/0.log"
Jul 02 17:57:23.608341 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:23.608311    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-zrx99_6df5bda9-11dc-43bb-8ccd-ba24c55f631f/payload-processing/0.log"
Jul 02 17:57:24.408173 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:24.408149    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6xw2l_0985ac1a-605a-485d-a109-3096143c91ef/main/0.log"
Jul 02 17:57:31.523341 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:31.523311    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j9gxg_1f43ef34-2095-452e-9da1-b557b4ac5d11/global-pull-secret-syncer/0.log"
Jul 02 17:57:31.672811 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:31.672779    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kdmx6_309ddb97-fafb-42f2-b000-197b4c371c6c/konnectivity-agent/0.log"
Jul 02 17:57:31.693514 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:31.693487    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-98.ec2.internal_8af002de85c52f61eae8d9d440ef017d/haproxy/0.log"
Jul 02 17:57:38.524179 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.524149    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-45pgl_1d008f36-b1b6-42fc-8792-083acd49db0d/monitoring-plugin/0.log"
Jul 02 17:57:38.628533 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.628503    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gljqs_4df92017-7195-484f-aad5-481d50108bfc/node-exporter/0.log"
Jul 02 17:57:38.651186 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.651155    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gljqs_4df92017-7195-484f-aad5-481d50108bfc/kube-rbac-proxy/0.log"
Jul 02 17:57:38.673537 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.673507    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gljqs_4df92017-7195-484f-aad5-481d50108bfc/init-textfile/0.log"
Jul 02 17:57:38.858453 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.858379    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0/prometheus/0.log"
Jul 02 17:57:38.886316 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.886294    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0/config-reloader/0.log"
Jul 02 17:57:38.929378 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.929352    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0/thanos-sidecar/0.log"
Jul 02 17:57:38.959573 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.959543    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0/kube-rbac-proxy-web/0.log"
Jul 02 17:57:38.991847 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:38.991802    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0/kube-rbac-proxy/0.log"
Jul 02 17:57:39.017808 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.017783    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0/kube-rbac-proxy-thanos/0.log"
Jul 02 17:57:39.041810 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.041783    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5b5f1fe1-b82c-44a9-a4c5-97997b4c5ca0/init-config-reloader/0.log"
Jul 02 17:57:39.146030 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.146004    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-t4779_db7f135f-7a29-49ec-8dcd-56e9b3dc5c2c/prometheus-operator-admission-webhook/0.log"
Jul 02 17:57:39.256962 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.256936    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74c894c97d-g6wg2_d93eabfc-f5b1-4b09-a924-f8f22e648816/thanos-query/0.log"
Jul 02 17:57:39.283261 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.283232    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74c894c97d-g6wg2_d93eabfc-f5b1-4b09-a924-f8f22e648816/kube-rbac-proxy-web/0.log"
Jul 02 17:57:39.306349 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.306325    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74c894c97d-g6wg2_d93eabfc-f5b1-4b09-a924-f8f22e648816/kube-rbac-proxy/0.log"
Jul 02 17:57:39.331127 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.331097    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74c894c97d-g6wg2_d93eabfc-f5b1-4b09-a924-f8f22e648816/prom-label-proxy/0.log"
Jul 02 17:57:39.353045 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.353016    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74c894c97d-g6wg2_d93eabfc-f5b1-4b09-a924-f8f22e648816/kube-rbac-proxy-rules/0.log"
Jul 02 17:57:39.376755 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:39.376684    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74c894c97d-g6wg2_d93eabfc-f5b1-4b09-a924-f8f22e648816/kube-rbac-proxy-metrics/0.log"
Jul 02 17:57:42.098074 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098037    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"]
Jul 02 17:57:42.098540 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098502    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy"
Jul 02 17:57:42.098540 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098520    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy"
Jul 02 17:57:42.098540 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098543    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" containerName="maas-api"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098550    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" containerName="maas-api"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098565    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098574    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098607    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71e8a57a-6040-4674-985e-7f044103dd8a" containerName="maas-api"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098616    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="71e8a57a-6040-4674-985e-7f044103dd8a" containerName="maas-api"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098713    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc06e49a-3075-4a6e-9cd5-7853695b6feb" containerName="istio-proxy"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098721    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2083f1-dfa7-4e28-8be0-0a4d302dd1c6" containerName="istio-proxy"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098730    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="71e8a57a-6040-4674-985e-7f044103dd8a" containerName="maas-api"
Jul 02 17:57:42.098732 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.098738    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="773c11b4-bf4b-46d6-8e9a-63b471e2a3a3" containerName="maas-api"
Jul 02 17:57:42.102275 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.102258    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.104493 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.104471    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cxcl8\"/\"kube-root-ca.crt\""
Jul 02 17:57:42.104682 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.104664    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cxcl8\"/\"default-dockercfg-sjc59\""
Jul 02 17:57:42.104964 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.104948    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cxcl8\"/\"openshift-service-ca.crt\""
Jul 02 17:57:42.110717 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.110693    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"]
Jul 02 17:57:42.198919 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.198881    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-sys\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.198919 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.198923    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-podres\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.199134 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.198999    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5cvd\" (UniqueName: \"kubernetes.io/projected/de1a876f-1731-42fb-9399-711007714322-kube-api-access-k5cvd\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.199134 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.199034    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-proc\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.199134 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.199114    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-lib-modules\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.299784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.299746    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-sys\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.299784 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.299791    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-podres\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.300037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.299831    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5cvd\" (UniqueName: \"kubernetes.io/projected/de1a876f-1731-42fb-9399-711007714322-kube-api-access-k5cvd\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.300037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.299849    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-proc\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.300037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.299880    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-sys\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.300037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.299926    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-lib-modules\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.300037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.299934    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-proc\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.300037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.299999    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-podres\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.300037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.300031    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de1a876f-1731-42fb-9399-711007714322-lib-modules\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.307686 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.307653    2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5cvd\" (UniqueName: \"kubernetes.io/projected/de1a876f-1731-42fb-9399-711007714322-kube-api-access-k5cvd\") pod \"perf-node-gather-daemonset-l4kpj\" (UID: \"de1a876f-1731-42fb-9399-711007714322\") " pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.413940 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.413903    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:42.546922 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:42.546896    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"]
Jul 02 17:57:42.549677 ip-10-0-133-98 kubenswrapper[2550]: W0702 17:57:42.549649    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde1a876f_1731_42fb_9399_711007714322.slice/crio-b666d2bc9727d2457a4b2533f0b947933dafc875b1627af71b58de7f6be268c9 WatchSource:0}: Error finding container b666d2bc9727d2457a4b2533f0b947933dafc875b1627af71b58de7f6be268c9: Status 404 returned error can't find the container with id b666d2bc9727d2457a4b2533f0b947933dafc875b1627af71b58de7f6be268c9
Jul 02 17:57:43.270233 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:43.270192    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj" event={"ID":"de1a876f-1731-42fb-9399-711007714322","Type":"ContainerStarted","Data":"53b728567bfe22577f4f18438b92b1d80fa69969dd7f3ba201bd540c21b77986"}
Jul 02 17:57:43.270635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:43.270252    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj" event={"ID":"de1a876f-1731-42fb-9399-711007714322","Type":"ContainerStarted","Data":"b666d2bc9727d2457a4b2533f0b947933dafc875b1627af71b58de7f6be268c9"}
Jul 02 17:57:43.270635 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:43.270273    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:43.286321 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:43.286233    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj" podStartSLOduration=1.28621517 podStartE2EDuration="1.28621517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 17:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 17:57:43.28587999 +0000 UTC m=+2818.276840275" watchObservedRunningTime="2026-07-02 17:57:43.28621517 +0000 UTC m=+2818.277175426"
Jul 02 17:57:43.660629 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:43.660577    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zprb9_f8e33937-2ee1-417e-b72a-d42210ef3239/dns/0.log"
Jul 02 17:57:43.681404 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:43.681376    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zprb9_f8e33937-2ee1-417e-b72a-d42210ef3239/kube-rbac-proxy/0.log"
Jul 02 17:57:43.705862 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:43.705837    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kmsf9_499a1f52-1802-42a4-b958-40b25212a692/dns-node-resolver/0.log"
Jul 02 17:57:44.286075 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:44.286046    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9gjcr_1edae93b-ecb6-40fc-91a1-5ef01b981e95/node-ca/0.log"
Jul 02 17:57:45.334898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:45.334866    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mhft4_a7e3fcc4-411b-40fa-871a-9f31e47735db/istio-proxy/0.log"
Jul 02 17:57:45.471482 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:45.471444    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sz2dh_af35f710-1037-4ae3-b0ed-ccac8ee798ce/discovery/0.log"
Jul 02 17:57:45.590355 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:45.590268    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pmht6_aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a/istio-proxy/0.log"
Jul 02 17:57:45.622842 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:45.622792    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pmht6_aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a/istio-proxy/1.log"
Jul 02 17:57:45.657776 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:45.657749    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-s2lsq_8c232206-6448-4bec-b5ca-6799fd576adc/payload-pre-processing/0.log"
Jul 02 17:57:45.710898 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:45.710862    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-zrx99_6df5bda9-11dc-43bb-8ccd-ba24c55f631f/payload-processing/0.log"
Jul 02 17:57:46.463562 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:46.463528    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-44hnn_90a8562e-b969-4425-9ef3-5d30ac22fe70/serve-healthcheck-canary/0.log"
Jul 02 17:57:47.045952 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:47.045923    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kp86h_98bdd55e-42b1-40da-b91f-f13c72a0f375/kube-rbac-proxy/0.log"
Jul 02 17:57:47.068623 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:47.068585    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kp86h_98bdd55e-42b1-40da-b91f-f13c72a0f375/exporter/0.log"
Jul 02 17:57:47.090004 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:47.089969    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kp86h_98bdd55e-42b1-40da-b91f-f13c72a0f375/extractor/0.log"
Jul 02 17:57:49.288520 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:49.288443    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cxcl8/perf-node-gather-daemonset-l4kpj"
Jul 02 17:57:49.384616 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:49.384576    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7ff58cd6f4-7rjqh_3a36a944-beb2-439a-b5e1-bc7290106fa6/maas-api/0.log"
Jul 02 17:57:49.404791 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:49.404761    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29716890-gpc85_4bed1856-b159-4297-b887-0f901bd4e1b9/cleanup/0.log"
Jul 02 17:57:49.533465 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:49.533434    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85f9dc7b46-fv8tm_5f92d32f-433b-4c85-955e-1f2315dda012/manager/0.log"
Jul 02 17:57:49.611986 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:49.611907    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-sjxrr_4e867551-a8e2-491b-bf59-a85af1c5112d/server/0.log"
Jul 02 17:57:49.905555 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:49.905519    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546844fdf5-rqptz_ed8df491-0627-497f-a42f-2574a394bd0a/manager/0.log"
Jul 02 17:57:49.926703 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:49.926679    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546844fdf5-rqptz_ed8df491-0627-497f-a42f-2574a394bd0a/copy-manifests/0.log"
Jul 02 17:57:51.292928 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:51.292898    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f779dbb76-bgwfr_1294eb97-1c43-4a2c-9a98-5d56fb55ee5c/manager/0.log"
Jul 02 17:57:51.646046 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:51.646016    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mhft4_a7e3fcc4-411b-40fa-871a-9f31e47735db/istio-proxy/0.log"
Jul 02 17:57:51.757185 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:51.757155    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sz2dh_af35f710-1037-4ae3-b0ed-ccac8ee798ce/discovery/0.log"
Jul 02 17:57:51.806783 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:51.806746    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pmht6_aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a/istio-proxy/0.log"
Jul 02 17:57:51.842394 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:51.842359    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pmht6_aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a/istio-proxy/1.log"
Jul 02 17:57:51.868566 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:51.868520    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-s2lsq_8c232206-6448-4bec-b5ca-6799fd576adc/payload-pre-processing/0.log"
Jul 02 17:57:51.910088 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:51.909997    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-zrx99_6df5bda9-11dc-43bb-8ccd-ba24c55f631f/payload-processing/0.log"
Jul 02 17:57:53.278706 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:53.278620    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mhft4_a7e3fcc4-411b-40fa-871a-9f31e47735db/istio-proxy/0.log"
Jul 02 17:57:53.391174 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:53.391140    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sz2dh_af35f710-1037-4ae3-b0ed-ccac8ee798ce/discovery/0.log"
Jul 02 17:57:53.446259 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:53.446230    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pmht6_aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a/istio-proxy/0.log"
Jul 02 17:57:53.479283 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:53.479244    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pmht6_aa935ca9-c4c1-48d1-bcd7-f6e8d186c70a/istio-proxy/1.log"
Jul 02 17:57:53.501251 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:53.501219    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-s2lsq_8c232206-6448-4bec-b5ca-6799fd576adc/payload-pre-processing/0.log"
Jul 02 17:57:53.540034 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:53.539947    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-zrx99_6df5bda9-11dc-43bb-8ccd-ba24c55f631f/payload-processing/0.log"
Jul 02 17:57:58.276299 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.276270    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7d8c_f42b5fdf-69ac-4ce7-bf53-425516d05f89/kube-multus-additional-cni-plugins/0.log"
Jul 02 17:57:58.299119 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.299091    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7d8c_f42b5fdf-69ac-4ce7-bf53-425516d05f89/egress-router-binary-copy/0.log"
Jul 02 17:57:58.321368 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.321338    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7d8c_f42b5fdf-69ac-4ce7-bf53-425516d05f89/cni-plugins/0.log"
Jul 02 17:57:58.345453 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.345425    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7d8c_f42b5fdf-69ac-4ce7-bf53-425516d05f89/bond-cni-plugin/0.log"
Jul 02 17:57:58.368019 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.367993    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7d8c_f42b5fdf-69ac-4ce7-bf53-425516d05f89/routeoverride-cni/0.log"
Jul 02 17:57:58.390860 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.390793    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7d8c_f42b5fdf-69ac-4ce7-bf53-425516d05f89/whereabouts-cni-bincopy/0.log"
Jul 02 17:57:58.411513 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.411487    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d7d8c_f42b5fdf-69ac-4ce7-bf53-425516d05f89/whereabouts-cni/0.log"
Jul 02 17:57:58.450748 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.450715    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jq6vz_c043f0f2-4d45-4e44-859d-9666290b402a/kube-multus/0.log"
Jul 02 17:57:58.570738 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.570666    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8npvm_19f0cb34-ac3a-4521-bc54-c453c6db705c/network-metrics-daemon/0.log"
Jul 02 17:57:58.590385 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:58.590364    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8npvm_19f0cb34-ac3a-4521-bc54-c453c6db705c/kube-rbac-proxy/0.log"
Jul 02 17:57:59.824037 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:59.824011    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-controller/0.log"
Jul 02 17:57:59.844819 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:59.844794    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/1.log"
Jul 02 17:57:59.844819 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:59.844814    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovn-acl-logging/0.log"
Jul 02 17:57:59.865957 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:59.865933    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/kube-rbac-proxy-node/0.log"
Jul 02 17:57:59.887658 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:59.887625    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/kube-rbac-proxy-ovn-metrics/0.log"
Jul 02 17:57:59.907236 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:59.907205    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/northd/0.log"
Jul 02 17:57:59.932023 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:59.931993    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/nbdb/0.log"
Jul 02 17:57:59.953139 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:57:59.953117    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/sbdb/0.log"
Jul 02 17:58:00.003132 ip-10-0-133-98 kubenswrapper[2550]: I0702 17:58:00.003092    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6cxx_fbe7a1bc-f1f1-44cd-a7b0-da7cf617713c/ovnkube-controller/0.log"