Jul 26 15:05:10.496198 ip-10-0-132-129 systemd[1]: Starting Kubernetes Kubelet...
Jul 26 15:05:10.944681 ip-10-0-132-129 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:05:10.944681 ip-10-0-132-129 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 26 15:05:10.944681 ip-10-0-132-129 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:05:10.944681 ip-10-0-132-129 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 26 15:05:10.944681 ip-10-0-132-129 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:05:10.945550 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.945462    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 26 15:05:10.951692 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951666    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:05:10.951692 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951687    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:05:10.951692 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951691    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:05:10.951692 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951695    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:05:10.951692 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951697    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:05:10.951692 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951701    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951704    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951707    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951710    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951713    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951716    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951718    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951721    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951724    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951726    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951729    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951732    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951734    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951737    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951739    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951742    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951745    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951748    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951752    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:05:10.951931 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951757    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951760    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951763    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951774    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951778    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951780    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951783    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951786    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951788    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951791    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951794    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951797    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951800    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951803    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951806    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951809    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951814    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951818    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951821    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951824    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:05:10.952380 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951827    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951829    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951832    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951836    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951839    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951842    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951852    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951855    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951858    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951860    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951863    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951866    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951868    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951871    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951873    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951876    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951878    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951885    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951902    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:05:10.952877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951905    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951908    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951911    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951914    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951917    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951919    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951922    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951924    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951928    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951930    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951933    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951936    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951938    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951941    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951944    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951947    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951949    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951952    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951954    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951957    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:05:10.953347 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951961    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951964    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951966    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951969    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951972    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951975    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951977    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951980    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951982    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951985    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951987    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951989    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951992    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951995    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.951997    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952000    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952738    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952745    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952749    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952752    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:05:10.953944 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952755    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952757    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952760    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952763    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952766    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952769    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952771    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952774    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952777    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952780    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952782    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952786    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952791    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952794    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952796    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952799    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952801    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952804    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952807    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952809    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:05:10.954420 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952812    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952814    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952817    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952819    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952821    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952824    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952826    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952829    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952831    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952834    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952837    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952840    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952843    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952846    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952848    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952851    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952853    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952856    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952859    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952861    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:05:10.954932 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952864    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952866    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952869    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952873    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952877    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952880    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952898    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952902    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952905    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952908    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952911    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952914    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952917    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952919    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952922    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952925    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952927    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952931    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952933    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952936    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:05:10.955421 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952939    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952942    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952945    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952948    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952951    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952954    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952957    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952959    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952962    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952964    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952967    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952969    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952972    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952974    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952976    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952979    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952981    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952984    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952986    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:05:10.955922 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952989    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952992    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952994    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952997    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.952999    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953002    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953004    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953007    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953009    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953012    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953014    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953018    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953021    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953025    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953028    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953031    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953411    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953417    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953420    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:05:10.956389 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953423    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953426    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953429    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953431    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953434    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953437    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953439    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953442    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953444    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953447    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953450    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953453    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953455    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953459    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953462    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953466    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953469    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953472    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953475    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:05:10.956898 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953478    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953480    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953483    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953486    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953488    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953491    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953493    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953496    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953499    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953501    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953504    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953506    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953509    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953511    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953514    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953516    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953519    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953522    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953524    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953526    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:05:10.957368 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953529    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953531    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953534    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953536    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953539    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953542    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953544    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953553    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953556    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953560    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953563    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953566    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953569    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953572    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953575    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953577    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953580    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953582    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953585    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:05:10.957866 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953588    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953590    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953593    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953596    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953598    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953601    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953603    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953606    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953608    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953611    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953614    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953616    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953619    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953621    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953623    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953626    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953629    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953631    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953633    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953638    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:05:10.958409 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953641    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953644    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953647    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953649    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953652    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953654    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953658    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953660    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953663    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953665    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953668    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953673    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953676    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953679    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953681    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953684    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953686    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.953689    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953765    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953775    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953783    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 26 15:05:10.958911 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953787    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953791    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953795    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953799    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953803    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953806    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953809    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953813    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953816    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953819    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953822    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953825    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953828    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953831    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953834    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953838    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953841    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953845    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953848    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953851    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953855    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953858    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953863    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 26 15:05:10.959451 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953866    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953869    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953872    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953875    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953879    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953881    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953897    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953900    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953903    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953906    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953909    2580 flags.go:64] FLAG: --enable-server="true"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953912    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953941    2580 flags.go:64] FLAG: --event-burst="100"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953945    2580 flags.go:64] FLAG: --event-qps="50"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953948    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953951    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953954    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953962    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953966    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953969    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953972    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953975    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953978    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953981    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953984    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 26 15:05:10.960016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953987    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953990    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953993    2580 flags.go:64] FLAG: --feature-gates=""
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.953997    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954000    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954003    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954007    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954011    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954013    2580 flags.go:64] FLAG: --help="false"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954016    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-132-129.ec2.internal"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954022    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954025    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954028    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954031    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954034    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954037    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954041    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954044    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954046    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954049    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954053    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954056    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954058    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954061    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 26 15:05:10.960655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954064    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954067    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954070    2580 flags.go:64] FLAG: --lock-file=""
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954073    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954076    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954079    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954084    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954088    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954091    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954094    2580 flags.go:64] FLAG: --logging-format="text"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954097    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954100    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954103    2580 flags.go:64] FLAG: --manifest-url=""
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954106    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954111    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954115    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954119    2580 flags.go:64] FLAG: --max-pods="110"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954122    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954126    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954129    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954132    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954135    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954138    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954141    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954148    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 26 15:05:10.961264 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954151    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954154    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954157    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954160    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954165    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954168    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954170    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954174    2580 flags.go:64] FLAG: --port="10250"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954177    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954180    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c7a6196db472799"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954183    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954186    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954188    2580 flags.go:64] FLAG: --register-node="true"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954191    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954195    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954198    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954201    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954204    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954208    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954211    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954214    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954217    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954221    2580 flags.go:64] FLAG: --runonce="false"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954224    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954227    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 26 15:05:10.961863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954231    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954234    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954236    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954239    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954242    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954245    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954248    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954251    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954254    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954257    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954259    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954262    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954266    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954271    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954274    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954277    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954281    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954283    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954286    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954289    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954292    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954295    2580 flags.go:64] FLAG: --v="2"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954299    2580 flags.go:64] FLAG: --version="false"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954303    2580 flags.go:64] FLAG: --vmodule=""
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954307    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 26 15:05:10.962491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954310    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954422    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954425    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954428    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954432    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954435    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954438    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954441    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954444    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954447    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954449    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954452    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954454    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954457    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954460    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954464    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954468    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954471    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954473    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954476    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:05:10.963156 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954479    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954482    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954485    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954488    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954491    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954493    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954496    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954499    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954502    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954505    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954509    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954520    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954522    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954525    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954528    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954530    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954534    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954536    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954539    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:05:10.963646 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954544    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954546    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954549    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954551    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954554    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954556    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954559    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954561    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954564    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954566    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954569    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954571    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954574    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954577    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954579    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954582    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954584    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954587    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954590    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954592    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:05:10.964117 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954595    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954597    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954600    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954602    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954605    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954608    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954611    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954614    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954616    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954621    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954623    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954626    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954629    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954632    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954634    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954637    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954640    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954642    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954645    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954647    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:05:10.964611 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954650    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954652    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954655    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954658    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954660    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954663    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954666    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954668    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954670    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954673    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954675    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954678    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954680    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954683    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954687    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954690    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954693    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954696    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954699    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:05:10.965118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954702    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.954704    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.954712    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.961595    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.961612    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.961630    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.961636    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961693    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961698    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961701    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961705    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961708    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961711    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961714    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961718    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:05:10.965578 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961720    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961723    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961726    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961729    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961732    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961735    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961738    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961741    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961743    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961746    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961748    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961751    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961753    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961756    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961758    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961761    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961763    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961766    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961769    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:05:10.965965 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961772    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961775    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961779    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961782    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961784    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961787    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961790    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961792    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961795    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961797    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961801    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961805    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961808    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961812    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961815    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961818    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961821    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961823    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961826    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:05:10.966416 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961828    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961831    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961834    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961836    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961839    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961841    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961844    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961847    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961849    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961851    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961854    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961857    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961859    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961862    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961864    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961868    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961871    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961874    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961877    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961880    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:05:10.966878 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961883    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961885    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961905    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961908    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961910    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961913    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961917    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961921    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961924    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961927    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961930    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961932    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961935    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961938    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961940    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961943    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961946    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961949    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961951    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:05:10.967523 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961954    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961956    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961959    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961961    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961964    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961967    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961969    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961972    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961976    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961979    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961982    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961985    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961987    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.961990    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.961995    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:05:10.967995 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962109    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962114    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962117    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962120    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962123    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962126    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962128    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962131    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962134    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962136    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962139    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962141    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962144    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962146    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962149    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962151    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962154    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962156    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962159    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:05:10.968359 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962161    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962164    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962166    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962169    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962171    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962174    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962177    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962180    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962183    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962186    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962188    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962191    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962194    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962196    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962199    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962201    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962204    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962207    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962209    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:05:10.968824 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962211    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962214    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962216    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962219    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962221    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962224    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962226    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962229    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962231    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962234    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962237    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962239    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962242    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962244    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962247    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962249    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962252    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962254    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962257    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962260    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:05:10.969303 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962263    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962265    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962268    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962271    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962274    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962276    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962278    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962281    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962284    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962286    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962289    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962292    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962294    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962296    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962299    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962301    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962304    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962306    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962309    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962311    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:05:10.969785 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962314    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962316    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962319    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962321    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962324    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962326    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962329    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962331    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962334    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962336    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962339    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962343    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962346    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962351    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962354    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962357    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962360    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962363    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962365    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:05:10.970275 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962369    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:05:10.970743 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:10.962373    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:05:10.970743 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.962378    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:05:10.970743 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.962483    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 26 15:05:10.970743 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.964883    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 26 15:05:10.970743 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.966534    2580 server.go:1019] "Starting client certificate rotation"
Jul 26 15:05:10.970743 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.966639    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 15:05:10.970743 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.966669    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 15:05:10.970743 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.969502    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 15:05:10.974943 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.974920    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 15:05:10.987053 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.987032    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 26 15:05:10.990438 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.990421    2580 log.go:25] "Validated CRI v1 image API"
Jul 26 15:05:10.991302 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.991285    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 26 15:05:10.996774 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.996748    2580 fs.go:135] Filesystem UUIDs: map[4547691c-669c-4da0-8154-626cbc0d77d1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c12dc7f4-97e3-4068-b1e0-77d0e84637c1:/dev/nvme0n1p3]
Jul 26 15:05:10.996843 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:10.996775    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 26 15:05:11.000500 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.000483    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 15:05:11.001471 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.001358    2580 manager.go:216] Machine: {Timestamp:2026-07-26 15:05:11.0008654 +0000 UTC m=+0.373915191 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097599 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fbaebf751a3065825e41aba62412a SystemUUID:ec2fbaeb-f751-a306-5825-e41aba62412a BootID:c75eb762-1931-4f1e-97b9-ff71e0302475 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a0:ab:a8:33:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a0:ab:a8:33:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:1b:de:ae:3e:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 26 15:05:11.001471 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.001463    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 26 15:05:11.001587 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.001580    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 26 15:05:11.005318 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.005292    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 26 15:05:11.005488 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.005326    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 26 15:05:11.006872 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.006859    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 26 15:05:11.006941 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.006879    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 26 15:05:11.006941 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.006906    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 15:05:11.007845 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.007833    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 15:05:11.009706 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.009694    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 26 15:05:11.014943 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.014928    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 15:05:11.015112 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.015101    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 26 15:05:11.015171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.015141    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 26 15:05:11.015171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.015155    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 26 15:05:11.015255 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.015172    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 26 15:05:11.015255 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.015187    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 26 15:05:11.015255 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.015201    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 26 15:05:11.015613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.015599    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 15:05:11.015677 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.015622    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 15:05:11.018986 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.018966    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 26 15:05:11.021009 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.020995    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 26 15:05:11.021066 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021025    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 26 15:05:11.021767 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021756    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 26 15:05:11.021799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021772    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 26 15:05:11.021799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021778    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 26 15:05:11.021799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021783    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 26 15:05:11.021799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021791    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 26 15:05:11.021799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021796    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 26 15:05:11.021990 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021968    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 26 15:05:11.021990 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021974    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 26 15:05:11.021990 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021982    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 26 15:05:11.021990 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021987    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 26 15:05:11.022160 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.021996    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 26 15:05:11.022160 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.022004    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 26 15:05:11.022904 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.022876    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 26 15:05:11.022904 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.022897    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 26 15:05:11.026222 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.026197    2580 server.go:1268] "Started kubelet"
Jul 26 15:05:11.026429 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.026285    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 26 15:05:11.026429 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.026315    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 26 15:05:11.026429 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.026362    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 26 15:05:11.028777 ip-10-0-132-129 systemd[1]: Started Kubernetes Kubelet.
Jul 26 15:05:11.030096 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.030073    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 26 15:05:11.030631 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.030613    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 26 15:05:11.030854 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.030831    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 26 15:05:11.034996 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.034871    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 26 15:05:11.034996 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.034902    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 26 15:05:11.035830 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.035812    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 26 15:05:11.035956 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.034844    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-129.ec2.internal.18c5df4420f5495d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-129.ec2.internal,UID:ip-10-0-132-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-129.ec2.internal,},FirstTimestamp:2026-07-26 15:05:11.025985885 +0000 UTC m=+0.399035665,LastTimestamp:2026-07-26 15:05:11.025985885 +0000 UTC m=+0.399035665,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-129.ec2.internal,}"
Jul 26 15:05:11.042454 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.042438    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hmfvg"
Jul 26 15:05:11.043677 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.043660    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 26 15:05:11.043677 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.043658    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 26 15:05:11.043830 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.043792    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.044461 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044445    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 26 15:05:11.044461 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044445    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 26 15:05:11.044613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044469    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 26 15:05:11.044613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044550    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 26 15:05:11.044613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044572    2580 factory.go:55] Registering systemd factory
Jul 26 15:05:11.044613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044581    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 26 15:05:11.044613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044592    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 26 15:05:11.044613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044602    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 26 15:05:11.044907 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044873    2580 factory.go:153] Registering CRI-O factory
Jul 26 15:05:11.044907 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044903    2580 factory.go:223] Registration of the crio container factory successfully
Jul 26 15:05:11.045048 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044927    2580 factory.go:103] Registering Raw factory
Jul 26 15:05:11.045048 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.044938    2580 manager.go:1196] Started watching for new ooms in manager
Jul 26 15:05:11.045503 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.045379    2580 manager.go:349] Starting recovery of all containers
Jul 26 15:05:11.045823 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.045801    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 26 15:05:11.046382 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.046353    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 26 15:05:11.049755 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.049728    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hmfvg"
Jul 26 15:05:11.057357 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.057341    2580 manager.go:354] Recovery completed
Jul 26 15:05:11.062382 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.062366    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:05:11.064599 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.064584    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:05:11.064658 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.064613    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:05:11.064658 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.064624    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:05:11.065301 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.065286    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 26 15:05:11.065301 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.065300    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:05:11.065437 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.065300    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 26 15:05:11.065437 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.065346    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 15:05:11.066065 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.066047    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:05:11.066134 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.066104    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:05:11.066134 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.066118    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:05:11.067486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.067466    2580 policy_none.go:49] "None policy: Start"
Jul 26 15:05:11.067562 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.067505    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 26 15:05:11.067562 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.067521    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 26 15:05:11.069790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.069774    2580 policy_none.go:47] "Start"
Jul 26 15:05:11.106789 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.106590    2580 manager.go:337] "Starting Device Plugin manager"
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.106844    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.106860    2580 server.go:87] "Starting device plugin registration server"
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.107127    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.107139    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.107243    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.107326    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.107334    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.109061    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 26 15:05:11.122234 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.109113    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.152185 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.152151    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 26 15:05:11.153296 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.153275    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 26 15:05:11.153443 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.153311    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 26 15:05:11.153443 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.153336    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 26 15:05:11.153443 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.153372    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 26 15:05:11.155112 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.155097    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:05:11.208014 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.207930    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:05:11.210278 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.210263    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:05:11.210364 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.210293    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:05:11.210364 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.210308    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:05:11.210364 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.210343    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.219031 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.219014    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.219087 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.219040    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-129.ec2.internal\": node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.240899 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.240858    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.253450 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.253425    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal"]
Jul 26 15:05:11.253511 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.253492    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:05:11.255011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.254993    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:05:11.255090 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.255022    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:05:11.255090 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.255033    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:05:11.257426 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.257409    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:05:11.257530 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.257515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.257568 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.257547    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:05:11.258733 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.258715    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:05:11.258812 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.258745    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:05:11.258812 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.258755    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:05:11.258812 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.258720    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:05:11.258922 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.258820    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:05:11.258922 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.258831    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:05:11.261034 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.261022    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.261077 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.261045    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:05:11.261757 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.261739    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:05:11.261824 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.261767    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:05:11.261824 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.261783    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:05:11.284733 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.284706    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-129.ec2.internal\" not found" node="ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.289277 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.289260    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-129.ec2.internal\" not found" node="ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.341571 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.341542    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.346940 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.346904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5986cddfb6ce017ac86c4cbabcc10a94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal\" (UID: \"5986cddfb6ce017ac86c4cbabcc10a94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.347037 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.346949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5986cddfb6ce017ac86c4cbabcc10a94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal\" (UID: \"5986cddfb6ce017ac86c4cbabcc10a94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.347037 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.346967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c1159a049b4ab46ac6d83e420ef873c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-129.ec2.internal\" (UID: \"3c1159a049b4ab46ac6d83e420ef873c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.442088 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.442052    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.447449 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.447433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5986cddfb6ce017ac86c4cbabcc10a94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal\" (UID: \"5986cddfb6ce017ac86c4cbabcc10a94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.447506 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.447463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5986cddfb6ce017ac86c4cbabcc10a94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal\" (UID: \"5986cddfb6ce017ac86c4cbabcc10a94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.447506 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.447481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c1159a049b4ab46ac6d83e420ef873c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-129.ec2.internal\" (UID: \"3c1159a049b4ab46ac6d83e420ef873c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.447575 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.447543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5986cddfb6ce017ac86c4cbabcc10a94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal\" (UID: \"5986cddfb6ce017ac86c4cbabcc10a94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.447614 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.447572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c1159a049b4ab46ac6d83e420ef873c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-129.ec2.internal\" (UID: \"3c1159a049b4ab46ac6d83e420ef873c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.447614 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.447543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5986cddfb6ce017ac86c4cbabcc10a94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal\" (UID: \"5986cddfb6ce017ac86c4cbabcc10a94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.542966 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.542879    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.587384 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.587344    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.592871 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.592579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:11.643380 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.643344    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.744321 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.744283    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.851926 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.851838    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.952994 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:11.952960    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:11.966079 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.966055    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 26 15:05:11.966223 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:11.966197    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 15:05:12.053215 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:12.053176    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:12.055460 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.055429    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-25 15:00:11 +0000 UTC" deadline="2028-02-01 01:48:34.245308435 +0000 UTC"
Jul 26 15:05:12.055518 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.055462    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13306h43m22.189850713s"
Jul 26 15:05:12.061706 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.061668    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:05:12.153885 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:12.153806    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:12.228157 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:12.228111    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1159a049b4ab46ac6d83e420ef873c.slice/crio-79ec2b7d87899aefbbdb57a06c391d5d3a58a78c7e18fbea8e5bd8943c99395e WatchSource:0}: Error finding container 79ec2b7d87899aefbbdb57a06c391d5d3a58a78c7e18fbea8e5bd8943c99395e: Status 404 returned error can't find the container with id 79ec2b7d87899aefbbdb57a06c391d5d3a58a78c7e18fbea8e5bd8943c99395e
Jul 26 15:05:12.228655 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:12.228627    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5986cddfb6ce017ac86c4cbabcc10a94.slice/crio-097ece9a762a51bd2fe2abc26065885993e072ed1df100cbbb2fa6008f4a6857 WatchSource:0}: Error finding container 097ece9a762a51bd2fe2abc26065885993e072ed1df100cbbb2fa6008f4a6857: Status 404 returned error can't find the container with id 097ece9a762a51bd2fe2abc26065885993e072ed1df100cbbb2fa6008f4a6857
Jul 26 15:05:12.234821 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.234806    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:05:12.254624 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:12.254596    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:12.355558 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:12.355516    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-129.ec2.internal\" not found"
Jul 26 15:05:12.386699 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.386672    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:05:12.444956 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.444854    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:12.457879 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.457856    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 15:05:12.459149 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.459134    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal"
Jul 26 15:05:12.467374 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.467357    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 15:05:12.519363 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:12.519340    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:05:13.016813 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.016776    2580 apiserver.go:52] "Watching apiserver"
Jul 26 15:05:13.026537 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.026500    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 26 15:05:13.027037 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.027005    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hrvqj","openshift-ovn-kubernetes/ovnkube-node-h2bwn","openshift-cluster-node-tuning-operator/tuned-t7rf9","openshift-dns/node-resolver-rf7vx","openshift-image-registry/node-ca-f2dp7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal","openshift-multus/multus-additional-cni-plugins-8gzmk","openshift-multus/multus-sjcs7","openshift-multus/network-metrics-daemon-qb9cd","openshift-network-diagnostics/network-check-target-hg7b2","kube-system/global-pull-secret-syncer-vsgfc","kube-system/konnectivity-agent-wtpbb","kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"]
Jul 26 15:05:13.030783 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.030096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.032746 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.032441    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.032746 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.032509    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:13.035032 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.033415    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 26 15:05:13.035032 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.033623    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 26 15:05:13.035032 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.033927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6z48m\""
Jul 26 15:05:13.035032 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.034199    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 26 15:05:13.035032 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.034410    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 26 15:05:13.035032 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.034640    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 26 15:05:13.037038 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.036861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.039137 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.039120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.039709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.039685    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xb6gx\""
Jul 26 15:05:13.040104 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.040080    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 26 15:05:13.040349 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.040329    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:05:13.041895 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.041755    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 26 15:05:13.042009 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.041980    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l8lwl\""
Jul 26 15:05:13.042105 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.042082    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 26 15:05:13.043074 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.043055    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.044307 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.044286    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 26 15:05:13.045523 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.045503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.046219 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.046198    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-knwdb\""
Jul 26 15:05:13.046312 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.046293    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 26 15:05:13.046528 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.046510    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 26 15:05:13.046596 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.046582    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 26 15:05:13.048169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.048148    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:13.048260 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.048222    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:13.048682 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.048665    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 26 15:05:13.049047 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.049027    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kcrhs\""
Jul 26 15:05:13.049129 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.049119    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 26 15:05:13.049461 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.049445    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 26 15:05:13.051095 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.050748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.053754 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.053722    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bbt8m\""
Jul 26 15:05:13.054456 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.054438    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 26 15:05:13.054720 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.054703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:13.056533 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.056512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:13.056632 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.056607    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:13.058171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.058148    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 26 15:05:13.058557 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.058539    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 26 15:05:13.058643 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.058598    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 15:05:13.058848 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.058829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vml2n\""
Jul 26 15:05:13.059336 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.059320    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.061470 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-socket-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.061553 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-registration-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.061553 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bwnc\" (UniqueName: \"kubernetes.io/projected/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-kube-api-access-8bwnc\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.061553 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.061727 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.061727 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-os-release\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.061727 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysconfig\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.061727 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-kubernetes\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.061727 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-sys\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.061727 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-lib-modules\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysctl-conf\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-var-lib-kubelet\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sdls\" (UniqueName: \"kubernetes.io/projected/9e4911fa-014e-43b2-82f6-0c5e9c24866b-kube-api-access-7sdls\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f740f8b6-ed75-43bf-8378-be860c4d5f3f-hosts-file\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f740f8b6-ed75-43bf-8378-be860c4d5f3f-tmp-dir\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nqzp\" (UniqueName: \"kubernetes.io/projected/f740f8b6-ed75-43bf-8378-be860c4d5f3f-kube-api-access-2nqzp\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-system-cni-dir\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.061981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.062041 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/204ac6d8-66c3-429a-890c-c1765678937c-dbus\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-systemd\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-device-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-sys-fs\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/204ac6d8-66c3-429a-890c-c1765678937c-kubelet-config\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-tuned\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj8d6\" (UniqueName: \"kubernetes.io/projected/91b8324b-a8e5-4108-b32b-2a378af644c0-kube-api-access-qj8d6\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-cnibin\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysctl-d\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-run\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.062535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-host\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e4911fa-014e-43b2-82f6-0c5e9c24866b-tmp\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91b8324b-a8e5-4108-b32b-2a378af644c0-host\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91b8324b-a8e5-4108-b32b-2a378af644c0-serviceca\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjxlt\" (UniqueName: \"kubernetes.io/projected/78c12206-8ddd-4769-9dc7-aa312103e616-kube-api-access-qjxlt\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-modprobe-d\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062860    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062881    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062889    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 26 15:05:13.063171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.062978    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tcfgc\""
Jul 26 15:05:13.063587 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.063535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.066607 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.066577    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 26 15:05:13.067833 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.067810    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p5tnt\""
Jul 26 15:05:13.068128 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.068078    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 26 15:05:13.068208 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.068139    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 26 15:05:13.068314 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.068269    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 26 15:05:13.068314 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.068292    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 26 15:05:13.068436 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.068395    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 26 15:05:13.078438 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.078407    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xc7s9"
Jul 26 15:05:13.086761 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.086742    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xc7s9"
Jul 26 15:05:13.146112 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.146073    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 26 15:05:13.159297 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.159231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal" event={"ID":"5986cddfb6ce017ac86c4cbabcc10a94","Type":"ContainerStarted","Data":"097ece9a762a51bd2fe2abc26065885993e072ed1df100cbbb2fa6008f4a6857"}
Jul 26 15:05:13.160805 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.160779    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal" event={"ID":"3c1159a049b4ab46ac6d83e420ef873c","Type":"ContainerStarted","Data":"79ec2b7d87899aefbbdb57a06c391d5d3a58a78c7e18fbea8e5bd8943c99395e"}
Jul 26 15:05:13.163244 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.163396 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-os-release\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.163466 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-kubelet\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.163466 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzrh\" (UniqueName: \"kubernetes.io/projected/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-kube-api-access-5tzrh\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.163577 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-host-slash\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.163577 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-log-socket\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.163688 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-env-overrides\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.163688 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:13.163798 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.163798 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/204ac6d8-66c3-429a-890c-c1765678937c-dbus\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.163798 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.163969 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.163898    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:13.164027 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.163977    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret podName:204ac6d8-66c3-429a-890c-c1765678937c nodeName:}" failed. No retries permitted until 2026-07-26 15:05:13.663957739 +0000 UTC m=+3.037007513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret") pod "global-pull-secret-syncer-vsgfc" (UID: "204ac6d8-66c3-429a-890c-c1765678937c") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:13.164027 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.164027 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.163977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.164194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-systemd\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.164194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/204ac6d8-66c3-429a-890c-c1765678937c-dbus\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.164194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-sys-fs\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.164194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-systemd\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.164194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164133    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-cnibin\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.164194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-sys-fs\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.164194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-tuned\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj8d6\" (UniqueName: \"kubernetes.io/projected/91b8324b-a8e5-4108-b32b-2a378af644c0-kube-api-access-qj8d6\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164264    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-socket-dir-parent\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-cnibin\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-run\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-host\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e4911fa-014e-43b2-82f6-0c5e9c24866b-tmp\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91b8324b-a8e5-4108-b32b-2a378af644c0-host\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-kubelet\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.164586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-host\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-var-lib-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bwnc\" (UniqueName: \"kubernetes.io/projected/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-kube-api-access-8bwnc\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-hostroot\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52k86\" (UniqueName: \"kubernetes.io/projected/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-kube-api-access-52k86\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-run\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-etc-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-kubernetes\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-sys\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-conf-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164960    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-var-lib-kubelet\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nqzp\" (UniqueName: \"kubernetes.io/projected/f740f8b6-ed75-43bf-8378-be860c4d5f3f-kube-api-access-2nqzp\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91b8324b-a8e5-4108-b32b-2a378af644c0-host\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-cni-binary-copy\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.164520    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 26 15:05:13.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-cnibin\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.166024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-sys\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.166024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovnkube-config\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.166024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-etc-kubernetes\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.166024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-iptables-alerter-script\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.166024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovnkube-script-lib\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.166024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165299    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.166024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.165541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-system-cni-dir\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.166374 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.166337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-var-lib-kubelet\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.166429 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.166394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-device-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.167163 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.166657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-device-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.167163 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.166726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/070513e9-0c74-4a2c-8425-949f30f92487-agent-certs\") pod \"konnectivity-agent-wtpbb\" (UID: \"070513e9-0c74-4a2c-8425-949f30f92487\") " pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:13.167163 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.166903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.167163 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.166939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-kubernetes\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.167482 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167456    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-system-cni-dir\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.167562 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/070513e9-0c74-4a2c-8425-949f30f92487-konnectivity-ca\") pod \"konnectivity-agent-wtpbb\" (UID: \"070513e9-0c74-4a2c-8425-949f30f92487\") " pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:13.167616 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/204ac6d8-66c3-429a-890c-c1765678937c-kubelet-config\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.167616 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-k8s-cni-cncf-io\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.167726 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-cni-bin\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.167726 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfwld\" (UniqueName: \"kubernetes.io/projected/3f03e5fc-b967-47e5-a60e-22a7a78204c6-kube-api-access-qfwld\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:13.167726 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysctl-d\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.167895 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91b8324b-a8e5-4108-b32b-2a378af644c0-serviceca\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.167895 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/204ac6d8-66c3-429a-890c-c1765678937c-kubelet-config\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.168027 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysctl-d\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.168027 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-socket-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.168027 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.167955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-registration-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.168027 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-cni-binary-copy\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.168233 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-daemon-config\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.168233 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-socket-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.168233 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-netns\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.168233 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168148    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-registration-dir\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.168233 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-cni-bin\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjxlt\" (UniqueName: \"kubernetes.io/projected/78c12206-8ddd-4769-9dc7-aa312103e616-kube-api-access-qjxlt\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-modprobe-d\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-cni-multus\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91b8324b-a8e5-4108-b32b-2a378af644c0-serviceca\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-slash\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-run-netns\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-node-log\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168455    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-modprobe-d\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.168486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-cni-netd\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.168989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.168989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-system-cni-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.168989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-systemd-units\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.168989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.168989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovn-node-metrics-cert\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.168989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhk96\" (UniqueName: \"kubernetes.io/projected/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-kube-api-access-mhk96\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.168989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-os-release\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.168989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.168995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysconfig\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-lib-modules\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/78c12206-8ddd-4769-9dc7-aa312103e616-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78c12206-8ddd-4769-9dc7-aa312103e616-os-release\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-systemd\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysconfig\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysctl-conf\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sdls\" (UniqueName: \"kubernetes.io/projected/9e4911fa-014e-43b2-82f6-0c5e9c24866b-kube-api-access-7sdls\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-lib-modules\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.169385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f740f8b6-ed75-43bf-8378-be860c4d5f3f-hosts-file\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.171544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.171489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e4911fa-014e-43b2-82f6-0c5e9c24866b-tmp\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.171544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-sysctl-conf\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.171544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.171568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f740f8b6-ed75-43bf-8378-be860c4d5f3f-tmp-dir\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.171544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e4911fa-014e-43b2-82f6-0c5e9c24866b-etc-tuned\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.171544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.169484    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f740f8b6-ed75-43bf-8378-be860c4d5f3f-hosts-file\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.171544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.171612    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-cni-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.171544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.171651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-multus-certs\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.171544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.171681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-ovn\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.172382 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.171945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f740f8b6-ed75-43bf-8378-be860c4d5f3f-tmp-dir\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.176995 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.176955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj8d6\" (UniqueName: \"kubernetes.io/projected/91b8324b-a8e5-4108-b32b-2a378af644c0-kube-api-access-qj8d6\") pod \"node-ca-f2dp7\" (UID: \"91b8324b-a8e5-4108-b32b-2a378af644c0\") " pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.178301 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.178276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nqzp\" (UniqueName: \"kubernetes.io/projected/f740f8b6-ed75-43bf-8378-be860c4d5f3f-kube-api-access-2nqzp\") pod \"node-resolver-rf7vx\" (UID: \"f740f8b6-ed75-43bf-8378-be860c4d5f3f\") " pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.178874 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.178827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sdls\" (UniqueName: \"kubernetes.io/projected/9e4911fa-014e-43b2-82f6-0c5e9c24866b-kube-api-access-7sdls\") pod \"tuned-t7rf9\" (UID: \"9e4911fa-014e-43b2-82f6-0c5e9c24866b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.179269 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.179247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bwnc\" (UniqueName: \"kubernetes.io/projected/3e0b22e0-41ed-45f1-92eb-4dcef5f6817c-kube-api-access-8bwnc\") pod \"aws-ebs-csi-driver-node-kjkpb\" (UID: \"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.180280 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.180258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjxlt\" (UniqueName: \"kubernetes.io/projected/78c12206-8ddd-4769-9dc7-aa312103e616-kube-api-access-qjxlt\") pod \"multus-additional-cni-plugins-8gzmk\" (UID: \"78c12206-8ddd-4769-9dc7-aa312103e616\") " pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.272594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-systemd\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.272594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272621    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272627    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-systemd\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-cni-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-multus-certs\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-ovn\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-os-release\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-multus-certs\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-cni-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-kubelet\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272828    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-ovn\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.272830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzrh\" (UniqueName: \"kubernetes.io/projected/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-kube-api-access-5tzrh\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-kubelet\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-host-slash\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-log-socket\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-os-release\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-log-socket\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.272939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-env-overrides\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-cnibin\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-host-slash\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-socket-dir-parent\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-cnibin\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-kubelet\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-var-lib-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.273187    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-socket-dir-parent\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.273372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-hostroot\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-run-ovn-kubernetes\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-kubelet\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.273261    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:13.773236733 +0000 UTC m=+3.146286495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52k86\" (UniqueName: \"kubernetes.io/projected/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-kube-api-access-52k86\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-hostroot\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273272    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-var-lib-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-etc-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-conf-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovnkube-config\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-etc-kubernetes\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-iptables-alerter-script\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovnkube-script-lib\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-etc-kubernetes\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/070513e9-0c74-4a2c-8425-949f30f92487-agent-certs\") pod \"konnectivity-agent-wtpbb\" (UID: \"070513e9-0c74-4a2c-8425-949f30f92487\") " pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-env-overrides\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/070513e9-0c74-4a2c-8425-949f30f92487-konnectivity-ca\") pod \"konnectivity-agent-wtpbb\" (UID: \"070513e9-0c74-4a2c-8425-949f30f92487\") " pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:13.274365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-k8s-cni-cncf-io\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-etc-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-cni-bin\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfwld\" (UniqueName: \"kubernetes.io/projected/3f03e5fc-b967-47e5-a60e-22a7a78204c6-kube-api-access-qfwld\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-cni-binary-copy\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-k8s-cni-cncf-io\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-daemon-config\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-netns\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-run-netns\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.273941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovnkube-config\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274013    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-conf-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274023    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-iptables-alerter-script\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-cni-bin\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-multus-daemon-config\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-cni-bin\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/070513e9-0c74-4a2c-8425-949f30f92487-konnectivity-ca\") pod \"konnectivity-agent-wtpbb\" (UID: \"070513e9-0c74-4a2c-8425-949f30f92487\") " pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-cni-multus\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274524    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-slash\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovnkube-script-lib\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-run-netns\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-cni-binary-copy\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-node-log\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274607    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-cni-bin\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-slash\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-run-netns\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274640    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-host-var-lib-cni-multus\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-node-log\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-cni-netd\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-system-cni-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-systemd-units\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274730    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-host-cni-netd\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovn-node-metrics-cert\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274776    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-systemd-units\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhk96\" (UniqueName: \"kubernetes.io/projected/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-kube-api-access-mhk96\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-system-cni-dir\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.275935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.274821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-run-openvswitch\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.276813 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.276788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/070513e9-0c74-4a2c-8425-949f30f92487-agent-certs\") pod \"konnectivity-agent-wtpbb\" (UID: \"070513e9-0c74-4a2c-8425-949f30f92487\") " pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:13.277335 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.277314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-ovn-node-metrics-cert\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.280983 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.280960    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:05:13.280983 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.280984    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:05:13.280983 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.280998    2580 projected.go:196] Error preparing data for projected volume kube-api-access-w86gl for pod openshift-network-diagnostics/network-check-target-hg7b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:13.281199 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.281089    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl podName:5e232b50-3a62-4dd7-808b-98084260487d nodeName:}" failed. No retries permitted until 2026-07-26 15:05:13.781071199 +0000 UTC m=+3.154120959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w86gl" (UniqueName: "kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl") pod "network-check-target-hg7b2" (UID: "5e232b50-3a62-4dd7-808b-98084260487d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:13.283065 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.283042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52k86\" (UniqueName: \"kubernetes.io/projected/ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9-kube-api-access-52k86\") pod \"iptables-alerter-hrvqj\" (UID: \"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9\") " pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.283260 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.283236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzrh\" (UniqueName: \"kubernetes.io/projected/dd4dbd31-3f80-4ef0-89c0-5e1db15f077c-kube-api-access-5tzrh\") pod \"multus-sjcs7\" (UID: \"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c\") " pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.285242 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.285217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfwld\" (UniqueName: \"kubernetes.io/projected/3f03e5fc-b967-47e5-a60e-22a7a78204c6-kube-api-access-qfwld\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:13.285361 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.285340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhk96\" (UniqueName: \"kubernetes.io/projected/c6e0aa16-e00a-4b57-a4dc-49889dffcaee-kube-api-access-mhk96\") pod \"ovnkube-node-h2bwn\" (UID: \"c6e0aa16-e00a-4b57-a4dc-49889dffcaee\") " pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.347489 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.347443    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8gzmk"
Jul 26 15:05:13.350608 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.350540    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:05:13.356265 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.356241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7rf9"
Jul 26 15:05:13.368288 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.368262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rf7vx"
Jul 26 15:05:13.376982 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.376960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f2dp7"
Jul 26 15:05:13.385998 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.385954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb"
Jul 26 15:05:13.394946 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.394925    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sjcs7"
Jul 26 15:05:13.402795 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.402775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:13.411807 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.411784    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrvqj"
Jul 26 15:05:13.419728 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.419706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:13.678121 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.678020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:13.678280 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.678199    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:13.678280 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.678270    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret podName:204ac6d8-66c3-429a-890c-c1765678937c nodeName:}" failed. No retries permitted until 2026-07-26 15:05:14.678253367 +0000 UTC m=+4.051303129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret") pod "global-pull-secret-syncer-vsgfc" (UID: "204ac6d8-66c3-429a-890c-c1765678937c") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:13.778441 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.778402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:13.778635 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.778585    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:13.778683 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.778668    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:14.778649075 +0000 UTC m=+4.151698834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:13.878954 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:13.878900    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:13.879143 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.879064    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:05:13.879143 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.879084    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:05:13.879143 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.879104    2580 projected.go:196] Error preparing data for projected volume kube-api-access-w86gl for pod openshift-network-diagnostics/network-check-target-hg7b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:13.879302 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:13.879162    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl podName:5e232b50-3a62-4dd7-808b-98084260487d nodeName:}" failed. No retries permitted until 2026-07-26 15:05:14.879143554 +0000 UTC m=+4.252193319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w86gl" (UniqueName: "kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl") pod "network-check-target-hg7b2" (UID: "5e232b50-3a62-4dd7-808b-98084260487d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:14.090110 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:14.090035    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 15:00:13 +0000 UTC" deadline="2028-01-17 07:44:37.047737527 +0000 UTC"
Jul 26 15:05:14.090110 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:14.090065    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12952h39m22.957675766s"
Jul 26 15:05:14.153599 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:14.153564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:14.153784 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.153682    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:14.294376 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.294332    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4911fa_014e_43b2_82f6_0c5e9c24866b.slice/crio-9d0ebcfe9d19b2bdec686e2ea229c0a6f7aecda337973d42ab5cf021d61712f8 WatchSource:0}: Error finding container 9d0ebcfe9d19b2bdec686e2ea229c0a6f7aecda337973d42ab5cf021d61712f8: Status 404 returned error can't find the container with id 9d0ebcfe9d19b2bdec686e2ea229c0a6f7aecda337973d42ab5cf021d61712f8
Jul 26 15:05:14.295821 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.295782    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b8324b_a8e5_4108_b32b_2a378af644c0.slice/crio-c0755c856aaf59887654d592a2a971bbd2b58716dd17470b3bdd5c113c7baaf4 WatchSource:0}: Error finding container c0755c856aaf59887654d592a2a971bbd2b58716dd17470b3bdd5c113c7baaf4: Status 404 returned error can't find the container with id c0755c856aaf59887654d592a2a971bbd2b58716dd17470b3bdd5c113c7baaf4
Jul 26 15:05:14.298415 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.298373    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf740f8b6_ed75_43bf_8378_be860c4d5f3f.slice/crio-a213081a08604f1f78157e39bd5c67a8853914da911baeeb52b5b4afe920d291 WatchSource:0}: Error finding container a213081a08604f1f78157e39bd5c67a8853914da911baeeb52b5b4afe920d291: Status 404 returned error can't find the container with id a213081a08604f1f78157e39bd5c67a8853914da911baeeb52b5b4afe920d291
Jul 26 15:05:14.320003 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.319936    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070513e9_0c74_4a2c_8425_949f30f92487.slice/crio-5d131fcf4e2385b9a2e5e39d9e6a88ad723887de3a8495456510adfa97460d11 WatchSource:0}: Error finding container 5d131fcf4e2385b9a2e5e39d9e6a88ad723887de3a8495456510adfa97460d11: Status 404 returned error can't find the container with id 5d131fcf4e2385b9a2e5e39d9e6a88ad723887de3a8495456510adfa97460d11
Jul 26 15:05:14.325121 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.325093    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c12206_8ddd_4769_9dc7_aa312103e616.slice/crio-eb3a20841b5fbdd619a469d6a3de153eac8df5af57d7d8fb35926bdea28a8971 WatchSource:0}: Error finding container eb3a20841b5fbdd619a469d6a3de153eac8df5af57d7d8fb35926bdea28a8971: Status 404 returned error can't find the container with id eb3a20841b5fbdd619a469d6a3de153eac8df5af57d7d8fb35926bdea28a8971
Jul 26 15:05:14.326094 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.326070    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e0aa16_e00a_4b57_a4dc_49889dffcaee.slice/crio-72933e70ce291b11fd1e4daa953be729ffcca7d8acda6265db906088f315d91f WatchSource:0}: Error finding container 72933e70ce291b11fd1e4daa953be729ffcca7d8acda6265db906088f315d91f: Status 404 returned error can't find the container with id 72933e70ce291b11fd1e4daa953be729ffcca7d8acda6265db906088f315d91f
Jul 26 15:05:14.327230 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.327195    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff432a1e_f7c0_4268_a63e_fa6e60ad6fb9.slice/crio-b071ebb98c3041c02dcbd2f1cdfb6d67cb87e4bcc57bd5e378036068d03203dc WatchSource:0}: Error finding container b071ebb98c3041c02dcbd2f1cdfb6d67cb87e4bcc57bd5e378036068d03203dc: Status 404 returned error can't find the container with id b071ebb98c3041c02dcbd2f1cdfb6d67cb87e4bcc57bd5e378036068d03203dc
Jul 26 15:05:14.328249 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.328134    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4dbd31_3f80_4ef0_89c0_5e1db15f077c.slice/crio-ddcf5e56c68f82884cd6d6d649fe489ebe2c3828cfd2e0079deebd4a5b95ccfa WatchSource:0}: Error finding container ddcf5e56c68f82884cd6d6d649fe489ebe2c3828cfd2e0079deebd4a5b95ccfa: Status 404 returned error can't find the container with id ddcf5e56c68f82884cd6d6d649fe489ebe2c3828cfd2e0079deebd4a5b95ccfa
Jul 26 15:05:14.329487 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:14.329463    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0b22e0_41ed_45f1_92eb_4dcef5f6817c.slice/crio-2a4e6400ad621de4993c8eee7dc69308950fa89c1da152206033c3e28a5a9ae4 WatchSource:0}: Error finding container 2a4e6400ad621de4993c8eee7dc69308950fa89c1da152206033c3e28a5a9ae4: Status 404 returned error can't find the container with id 2a4e6400ad621de4993c8eee7dc69308950fa89c1da152206033c3e28a5a9ae4
Jul 26 15:05:14.686399 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:14.686145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:14.686399 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.686305    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:14.686593 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.686450    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret podName:204ac6d8-66c3-429a-890c-c1765678937c nodeName:}" failed. No retries permitted until 2026-07-26 15:05:16.686427936 +0000 UTC m=+6.059477694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret") pod "global-pull-secret-syncer-vsgfc" (UID: "204ac6d8-66c3-429a-890c-c1765678937c") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:14.787005 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:14.786875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:14.787005 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.787005    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:14.787236 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.787075    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:16.787057595 +0000 UTC m=+6.160107376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:14.887525 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:14.887473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:14.887711 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.887662    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:05:14.887711 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.887688    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:05:14.887711 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.887702    2580 projected.go:196] Error preparing data for projected volume kube-api-access-w86gl for pod openshift-network-diagnostics/network-check-target-hg7b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:14.888012 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:14.887768    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl podName:5e232b50-3a62-4dd7-808b-98084260487d nodeName:}" failed. No retries permitted until 2026-07-26 15:05:16.887749027 +0000 UTC m=+6.260798801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w86gl" (UniqueName: "kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl") pod "network-check-target-hg7b2" (UID: "5e232b50-3a62-4dd7-808b-98084260487d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:15.091096 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.090919    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 15:00:13 +0000 UTC" deadline="2028-04-06 12:56:21.603966264 +0000 UTC"
Jul 26 15:05:15.091096 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.090989    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14877h51m6.512982233s"
Jul 26 15:05:15.158022 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.156544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:15.158022 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:15.156682    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:15.158022 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.157836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:15.158022 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:15.157950    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:15.178102 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.178065    2580 generic.go:356] "Generic (PLEG): container finished" podID="5986cddfb6ce017ac86c4cbabcc10a94" containerID="b82a7e09059537e8caab205fe53ad8e630203228c62a56bad6ec3e444c0a526b" exitCode=0
Jul 26 15:05:15.178530 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.178453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal" event={"ID":"5986cddfb6ce017ac86c4cbabcc10a94","Type":"ContainerDied","Data":"b82a7e09059537e8caab205fe53ad8e630203228c62a56bad6ec3e444c0a526b"}
Jul 26 15:05:15.198915 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.198877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal" event={"ID":"3c1159a049b4ab46ac6d83e420ef873c","Type":"ContainerStarted","Data":"28e428695407f58c2bedf9409543a41d3f1bbb869c6bf5028bcd5bdb0f0571e9"}
Jul 26 15:05:15.212733 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.212680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sjcs7" event={"ID":"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c","Type":"ContainerStarted","Data":"ddcf5e56c68f82884cd6d6d649fe489ebe2c3828cfd2e0079deebd4a5b95ccfa"}
Jul 26 15:05:15.214048 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.213986    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-129.ec2.internal" podStartSLOduration=3.213948057 podStartE2EDuration="3.213948057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:15.213463624 +0000 UTC m=+4.586513410" watchObservedRunningTime="2026-07-26 15:05:15.213948057 +0000 UTC m=+4.586997840"
Jul 26 15:05:15.216860 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.216825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" event={"ID":"78c12206-8ddd-4769-9dc7-aa312103e616","Type":"ContainerStarted","Data":"eb3a20841b5fbdd619a469d6a3de153eac8df5af57d7d8fb35926bdea28a8971"}
Jul 26 15:05:15.250938 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.250897    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wtpbb" event={"ID":"070513e9-0c74-4a2c-8425-949f30f92487","Type":"ContainerStarted","Data":"5d131fcf4e2385b9a2e5e39d9e6a88ad723887de3a8495456510adfa97460d11"}
Jul 26 15:05:15.267686 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.267584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7rf9" event={"ID":"9e4911fa-014e-43b2-82f6-0c5e9c24866b","Type":"ContainerStarted","Data":"9d0ebcfe9d19b2bdec686e2ea229c0a6f7aecda337973d42ab5cf021d61712f8"}
Jul 26 15:05:15.288129 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.288087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb" event={"ID":"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c","Type":"ContainerStarted","Data":"2a4e6400ad621de4993c8eee7dc69308950fa89c1da152206033c3e28a5a9ae4"}
Jul 26 15:05:15.299508 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.299389    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrvqj" event={"ID":"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9","Type":"ContainerStarted","Data":"b071ebb98c3041c02dcbd2f1cdfb6d67cb87e4bcc57bd5e378036068d03203dc"}
Jul 26 15:05:15.306138 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.305992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"72933e70ce291b11fd1e4daa953be729ffcca7d8acda6265db906088f315d91f"}
Jul 26 15:05:15.310613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.310541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f2dp7" event={"ID":"91b8324b-a8e5-4108-b32b-2a378af644c0","Type":"ContainerStarted","Data":"c0755c856aaf59887654d592a2a971bbd2b58716dd17470b3bdd5c113c7baaf4"}
Jul 26 15:05:15.316924 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:15.316894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rf7vx" event={"ID":"f740f8b6-ed75-43bf-8378-be860c4d5f3f","Type":"ContainerStarted","Data":"a213081a08604f1f78157e39bd5c67a8853914da911baeeb52b5b4afe920d291"}
Jul 26 15:05:16.154829 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:16.154238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:16.154829 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.154395    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:16.337781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:16.337570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal" event={"ID":"5986cddfb6ce017ac86c4cbabcc10a94","Type":"ContainerStarted","Data":"100b90c57a7ad24f64289b0cab677a985f47f60dff35e7b04968ccf85a587097"}
Jul 26 15:05:16.707418 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:16.707354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:16.707612 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.707514    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:16.707612 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.707583    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret podName:204ac6d8-66c3-429a-890c-c1765678937c nodeName:}" failed. No retries permitted until 2026-07-26 15:05:20.707563667 +0000 UTC m=+10.080613428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret") pod "global-pull-secret-syncer-vsgfc" (UID: "204ac6d8-66c3-429a-890c-c1765678937c") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:16.808371 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:16.808315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:16.808569 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.808517    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:16.808634 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.808585    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:20.808564278 +0000 UTC m=+10.181614050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:16.909308 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:16.909220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:16.909524 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.909379    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:05:16.909524 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.909403    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:05:16.909524 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.909416    2580 projected.go:196] Error preparing data for projected volume kube-api-access-w86gl for pod openshift-network-diagnostics/network-check-target-hg7b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:16.909524 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:16.909501    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl podName:5e232b50-3a62-4dd7-808b-98084260487d nodeName:}" failed. No retries permitted until 2026-07-26 15:05:20.909481624 +0000 UTC m=+10.282531391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w86gl" (UniqueName: "kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl") pod "network-check-target-hg7b2" (UID: "5e232b50-3a62-4dd7-808b-98084260487d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:17.156178 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:17.156102    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:17.156623 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:17.156245    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:17.156690 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:17.156636    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:17.156768 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:17.156738    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:18.154394 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:18.153861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:18.154394 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:18.154009    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:19.154488 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:19.154419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:19.154958 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:19.154419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:19.154958 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:19.154563    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:19.154958 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:19.154635    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:20.153870 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:20.153836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:20.154073 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.153978    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:20.744224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:20.744184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:20.744686 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.744361    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:20.744686 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.744443    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret podName:204ac6d8-66c3-429a-890c-c1765678937c nodeName:}" failed. No retries permitted until 2026-07-26 15:05:28.744423049 +0000 UTC m=+18.117472831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret") pod "global-pull-secret-syncer-vsgfc" (UID: "204ac6d8-66c3-429a-890c-c1765678937c") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:20.845406 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:20.845372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:20.845592 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.845513    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:20.845592 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.845586    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:28.845565259 +0000 UTC m=+18.218615020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:20.945902 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:20.945847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:20.946080 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.946058    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:05:20.946080 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.946086    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:05:20.946280 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.946100    2580 projected.go:196] Error preparing data for projected volume kube-api-access-w86gl for pod openshift-network-diagnostics/network-check-target-hg7b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:20.946280 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:20.946163    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl podName:5e232b50-3a62-4dd7-808b-98084260487d nodeName:}" failed. No retries permitted until 2026-07-26 15:05:28.946144346 +0000 UTC m=+18.319194106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w86gl" (UniqueName: "kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl") pod "network-check-target-hg7b2" (UID: "5e232b50-3a62-4dd7-808b-98084260487d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:21.154432 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:21.154351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:21.154602 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:21.154471    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:21.154666 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:21.154628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:21.154760 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:21.154736    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:22.153758 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:22.153723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:22.154245 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:22.153860    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:23.155352 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:23.154601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:23.155352 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:23.154607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:23.155352 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:23.154848    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:23.155352 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:23.154955    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:24.154126 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:24.154086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:24.154291 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:24.154228    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:25.154587 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:25.154505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:25.155038 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:25.154651    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:25.155038 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:25.154703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:25.155038 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:25.154836    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:26.153518 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:26.153479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:26.153695 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:26.153624    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:27.154254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:27.154213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:27.154759 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:27.154229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:27.154759 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:27.154334    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:27.154759 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:27.154413    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:28.153996 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:28.153962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:28.154230 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:28.154095    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:28.804040 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:28.803939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:28.804550 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:28.804124    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:28.804550 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:28.804211    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret podName:204ac6d8-66c3-429a-890c-c1765678937c nodeName:}" failed. No retries permitted until 2026-07-26 15:05:44.804188266 +0000 UTC m=+34.177238034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret") pod "global-pull-secret-syncer-vsgfc" (UID: "204ac6d8-66c3-429a-890c-c1765678937c") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:28.904570 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:28.904527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:28.904743 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:28.904703    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:28.904797 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:28.904786    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:44.904762823 +0000 UTC m=+34.277812603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:29.005796 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:29.005757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:29.005989 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:29.005946    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:05:29.005989 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:29.005975    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:05:29.005989 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:29.005989    2580 projected.go:196] Error preparing data for projected volume kube-api-access-w86gl for pod openshift-network-diagnostics/network-check-target-hg7b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:29.006192 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:29.006041    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl podName:5e232b50-3a62-4dd7-808b-98084260487d nodeName:}" failed. No retries permitted until 2026-07-26 15:05:45.006028021 +0000 UTC m=+34.379077783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w86gl" (UniqueName: "kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl") pod "network-check-target-hg7b2" (UID: "5e232b50-3a62-4dd7-808b-98084260487d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:29.154101 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:29.154010    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:29.154257 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:29.154150    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:29.154257 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:29.154202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:29.154373 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:29.154289    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:30.153970 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:30.153931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:30.154381 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:30.154043    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:31.154555 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:31.154520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:31.154996 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:31.154650    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:31.154996 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:31.154713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:31.154996 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:31.154831    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:32.153936 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:32.153904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:32.154128 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:32.154038    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:33.154765 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.154468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:33.155563 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.154519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:33.155563 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:33.154857    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:33.155563 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:33.154930    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:33.376216 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.376181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sjcs7" event={"ID":"dd4dbd31-3f80-4ef0-89c0-5e1db15f077c","Type":"ContainerStarted","Data":"2821c6d43c9dc8b08c9c735f9e9cd0e838c5dc3a6ef7b345f2997a08a821fb7c"}
Jul 26 15:05:33.377848 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.377821    2580 generic.go:356] "Generic (PLEG): container finished" podID="78c12206-8ddd-4769-9dc7-aa312103e616" containerID="4ce308d329a85c54a7ac5e836db981e43cf0e25162f72b49e1c25c3ad0438491" exitCode=0
Jul 26 15:05:33.377941 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.377918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" event={"ID":"78c12206-8ddd-4769-9dc7-aa312103e616","Type":"ContainerDied","Data":"4ce308d329a85c54a7ac5e836db981e43cf0e25162f72b49e1c25c3ad0438491"}
Jul 26 15:05:33.379281 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.379262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wtpbb" event={"ID":"070513e9-0c74-4a2c-8425-949f30f92487","Type":"ContainerStarted","Data":"cb500723867482f04910ea8b0f398f7dc2ea55c7fd3ea5fc882b2b58cb709eba"}
Jul 26 15:05:33.380844 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.380815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7rf9" event={"ID":"9e4911fa-014e-43b2-82f6-0c5e9c24866b","Type":"ContainerStarted","Data":"fe7bf0f482a7131faf36ebd76166e01de016d377e128340e6535a2227ea42f39"}
Jul 26 15:05:33.382112 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.382089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb" event={"ID":"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c","Type":"ContainerStarted","Data":"762c156fd588bfccc489817e5b0a1c5bc54f641cfab100a145e17e3b90f1b924"}
Jul 26 15:05:33.384409 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.384392    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"f85da384aea1a666d4e79cb761f4064e64643bb521afc9aae468201161424be1"}
Jul 26 15:05:33.384505 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.384443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"f4442fb85b507d3046d558ebf61e5e60b40044e57add3e714e6d815b6ae12c3d"}
Jul 26 15:05:33.384505 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.384482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"18c6a0298a9e09f11b15fae7933ffbb0d25b5d7b6d2f98579ef60467fa09e92c"}
Jul 26 15:05:33.384614 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.384524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"382100cb6b36a11d76956aa9f376c6f4d42211e2832c267a774a2861c8899bd8"}
Jul 26 15:05:33.384614 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.384555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"65e242702f7518b0f2641515143942a49cf8cf8f9258235a129993ddd43d8617"}
Jul 26 15:05:33.385790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.385739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f2dp7" event={"ID":"91b8324b-a8e5-4108-b32b-2a378af644c0","Type":"ContainerStarted","Data":"a88a203c0daf1322ae34fc65168b9bbf314903f257840924e4a88bbe9e328dcf"}
Jul 26 15:05:33.386963 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.386944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rf7vx" event={"ID":"f740f8b6-ed75-43bf-8378-be860c4d5f3f","Type":"ContainerStarted","Data":"db10a7c4af4fabdae3dda132705fc771cc3d6f71ccc1a678a5f2b3cea79a6d59"}
Jul 26 15:05:33.393489 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.393453    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-129.ec2.internal" podStartSLOduration=21.393441637 podStartE2EDuration="21.393441637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:16.353801163 +0000 UTC m=+5.726850936" watchObservedRunningTime="2026-07-26 15:05:33.393441637 +0000 UTC m=+22.766491417"
Jul 26 15:05:33.393649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.393625    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sjcs7" podStartSLOduration=3.949580819 podStartE2EDuration="22.393618477s" totalImagesPullingTime="18.444037658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:33.393056798 +0000 UTC m=+22.766106579" watchObservedRunningTime="2026-07-26 15:05:33.393618477 +0000 UTC m=+22.766668256"
Jul 26 15:05:33.425070 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.425033    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f2dp7" podStartSLOduration=4.032133831 podStartE2EDuration="22.425019544s" totalImagesPullingTime="18.392885713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:33.424835656 +0000 UTC m=+22.797885436" watchObservedRunningTime="2026-07-26 15:05:33.425019544 +0000 UTC m=+22.798069323"
Jul 26 15:05:33.449445 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.449401    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wtpbb" podStartSLOduration=4.061288062 podStartE2EDuration="22.449381457s" totalImagesPullingTime="18.388093395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:33.449034551 +0000 UTC m=+22.822084340" watchObservedRunningTime="2026-07-26 15:05:33.449381457 +0000 UTC m=+22.822431237"
Jul 26 15:05:33.467399 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.467353    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t7rf9" podStartSLOduration=4.072484626 podStartE2EDuration="22.467338388s" totalImagesPullingTime="18.394853762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:33.466762071 +0000 UTC m=+22.839811851" watchObservedRunningTime="2026-07-26 15:05:33.467338388 +0000 UTC m=+22.840388167"
Jul 26 15:05:33.484440 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:33.484398    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rf7vx" podStartSLOduration=4.086190702 podStartE2EDuration="22.484384938s" totalImagesPullingTime="18.398194236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:33.484161847 +0000 UTC m=+22.857211627" watchObservedRunningTime="2026-07-26 15:05:33.484384938 +0000 UTC m=+22.857434719"
Jul 26 15:05:34.153536 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:34.153508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:34.153698 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:34.153629    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:34.166993 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:34.166937    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 26 15:05:34.391418 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:34.391333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb" event={"ID":"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c","Type":"ContainerStarted","Data":"87cf03247bc2ba199fff5cf0bdae480a47ff03d24e96ef547765275cd8c5216e"}
Jul 26 15:05:34.392974 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:34.392936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrvqj" event={"ID":"ff432a1e-f7c0-4268-a63e-fa6e60ad6fb9","Type":"ContainerStarted","Data":"e7803c5b6fa36b1caf16f992c62cd5141f743c0738261d34172b4aeb537701f5"}
Jul 26 15:05:34.399581 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:34.399552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"056ca3f77d5b27805c3c148b8d145c3ae2605dd6653dda42d478ab45c18f14f9"}
Jul 26 15:05:34.408777 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:34.408735    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hrvqj" podStartSLOduration=5.027803059 podStartE2EDuration="23.408723106s" totalImagesPullingTime="18.380920047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:34.408486219 +0000 UTC m=+23.781535999" watchObservedRunningTime="2026-07-26 15:05:34.408723106 +0000 UTC m=+23.781772885"
Jul 26 15:05:34.835851 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:34.835768    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:34.836392 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:34.836357    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:35.121004 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.120831    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-26T15:05:34.166957589Z","UUID":"b4c1460a-34a0-46c5-acce-79e88a02cf76","Handler":null,"Name":"","Endpoint":""}
Jul 26 15:05:35.122410 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.122385    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 26 15:05:35.122530 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.122444    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 26 15:05:35.154195 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.154169    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:35.154339 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:35.154296    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:35.154409 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.154346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:35.154463 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:35.154434    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:35.401637 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.401597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb" event={"ID":"3e0b22e0-41ed-45f1-92eb-4dcef5f6817c","Type":"ContainerStarted","Data":"31c572f4091c3258e100c855179882972d9f201c6131eecc268722147d7f8eb0"}
Jul 26 15:05:35.402204 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.402179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:35.402509 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.402490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wtpbb"
Jul 26 15:05:35.419335 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:35.419299    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjkpb" podStartSLOduration=3.804157342 podStartE2EDuration="24.419285908s" totalImagesPullingTime="20.615128566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:35.418694157 +0000 UTC m=+24.791743975" watchObservedRunningTime="2026-07-26 15:05:35.419285908 +0000 UTC m=+24.792335687"
Jul 26 15:05:36.154385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:36.154351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:36.154565 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:36.154470    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:36.407798 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:36.407713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"b178d51f769a130b60b906d6e05896f56a7b1bb66f3f4db390b7432318d8f163"}
Jul 26 15:05:37.154514 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:37.154301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:37.154695 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:37.154311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:37.154695 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:37.154634    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:37.154856 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:37.154825    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:38.154294 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:38.154264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:38.154805 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:38.154360    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:38.413713 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:38.413626    2580 generic.go:356] "Generic (PLEG): container finished" podID="78c12206-8ddd-4769-9dc7-aa312103e616" containerID="3feec130f041f7e0a7d5373de7852393b06aa861fe248cb6d1c960b52258c798" exitCode=0
Jul 26 15:05:38.413908 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:38.413718    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" event={"ID":"78c12206-8ddd-4769-9dc7-aa312103e616","Type":"ContainerDied","Data":"3feec130f041f7e0a7d5373de7852393b06aa861fe248cb6d1c960b52258c798"}
Jul 26 15:05:38.417448 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:38.417428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" event={"ID":"c6e0aa16-e00a-4b57-a4dc-49889dffcaee","Type":"ContainerStarted","Data":"2aa6a90c1e2804fda5b16d498e72da6a9fc36211d264bcecd71aedb50df4f6ef"}
Jul 26 15:05:38.417731 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:38.417712    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:38.417833 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:38.417759    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:38.432638 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:38.432616    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:39.157383 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.157346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:39.157383 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.157381    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:39.157978 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:39.157524    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:39.157978 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:39.157712    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:39.420632 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.420552    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:39.434872 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.434842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:05:39.461747 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.461699    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn" podStartSLOduration=8.991597128 podStartE2EDuration="27.461685607s" totalImagesPullingTime="18.470088479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:38.478822326 +0000 UTC m=+27.851872101" watchObservedRunningTime="2026-07-26 15:05:39.461685607 +0000 UTC m=+28.834735385"
Jul 26 15:05:39.848135 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.848101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qb9cd"]
Jul 26 15:05:39.848308 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.848223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:39.848375 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:39.848318    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:39.851057 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.851024    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hg7b2"]
Jul 26 15:05:39.851173 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.851126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:39.851242 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:39.851220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:39.858878 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.858852    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vsgfc"]
Jul 26 15:05:39.858989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:39.858960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:39.859058 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:39.859042    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:40.423933 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:40.423881    2580 generic.go:356] "Generic (PLEG): container finished" podID="78c12206-8ddd-4769-9dc7-aa312103e616" containerID="47922f1c95637328002f3f61720b6348bb572df67f91be3de3809c1533f06fce" exitCode=0
Jul 26 15:05:40.423933 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:40.423923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" event={"ID":"78c12206-8ddd-4769-9dc7-aa312103e616","Type":"ContainerDied","Data":"47922f1c95637328002f3f61720b6348bb572df67f91be3de3809c1533f06fce"}
Jul 26 15:05:41.155005 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:41.154972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:41.155194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:41.155052    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:41.155194 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:41.155061    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:41.155194 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:41.155163    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:42.153868 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:42.153789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:42.154228 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:42.153909    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:42.432194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:42.431361    2580 generic.go:356] "Generic (PLEG): container finished" podID="78c12206-8ddd-4769-9dc7-aa312103e616" containerID="57484d190188e2961f920b175829a61eafbb8f6b80cea99750d4d2fcc04b0c31" exitCode=0
Jul 26 15:05:42.432194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:42.431672    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" event={"ID":"78c12206-8ddd-4769-9dc7-aa312103e616","Type":"ContainerDied","Data":"57484d190188e2961f920b175829a61eafbb8f6b80cea99750d4d2fcc04b0c31"}
Jul 26 15:05:43.153759 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:43.153721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:43.153940 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:43.153725    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:43.153940 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:43.153838    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:43.154427 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:43.153945    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:44.154304 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:44.154276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:44.154655 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:44.154395    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:44.825877 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:44.825840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:44.826061 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:44.825995    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:44.826061 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:44.826058    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret podName:204ac6d8-66c3-429a-890c-c1765678937c nodeName:}" failed. No retries permitted until 2026-07-26 15:06:16.826043615 +0000 UTC m=+66.199093371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret") pod "global-pull-secret-syncer-vsgfc" (UID: "204ac6d8-66c3-429a-890c-c1765678937c") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:05:44.926965 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:44.926926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:44.927123 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:44.927099    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:44.927203 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:44.927172    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:06:16.92715482 +0000 UTC m=+66.300204578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:05:45.028327 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:45.028291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:45.028499 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:45.028424    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:05:45.028499 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:45.028438    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:05:45.028499 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:45.028447    2580 projected.go:196] Error preparing data for projected volume kube-api-access-w86gl for pod openshift-network-diagnostics/network-check-target-hg7b2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:45.028499 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:45.028497    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl podName:5e232b50-3a62-4dd7-808b-98084260487d nodeName:}" failed. No retries permitted until 2026-07-26 15:06:17.028485327 +0000 UTC m=+66.401535083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w86gl" (UniqueName: "kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl") pod "network-check-target-hg7b2" (UID: "5e232b50-3a62-4dd7-808b-98084260487d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:05:45.153980 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:45.153879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:45.153980 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:45.153918    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:45.154183 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:45.154026    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:05:45.154183 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:45.154169    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg7b2" podUID="5e232b50-3a62-4dd7-808b-98084260487d"
Jul 26 15:05:46.153537 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.153510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:46.154037 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:46.153610    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vsgfc" podUID="204ac6d8-66c3-429a-890c-c1765678937c"
Jul 26 15:05:46.436136 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.436074    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-129.ec2.internal" event="NodeReady"
Jul 26 15:05:46.436266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.436205    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 26 15:05:46.469872 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.469686    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8564f8bd84-4dv75"]
Jul 26 15:05:46.471940 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.471917    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.474943 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.474922    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 26 15:05:46.475297 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.475277    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qhrv\""
Jul 26 15:05:46.475546 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.475530    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 26 15:05:46.475625 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.475586    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 26 15:05:46.483104 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.483086    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"]
Jul 26 15:05:46.484948 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.484237    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 26 15:05:46.485594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.485571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:46.489140 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.489083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8564f8bd84-4dv75"]
Jul 26 15:05:46.489602 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.489579    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 26 15:05:46.489826 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.489809    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sm44q\""
Jul 26 15:05:46.490057 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.490033    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 26 15:05:46.490951 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.490040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-27n6b"]
Jul 26 15:05:46.492279 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.491821    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dbp9s"]
Jul 26 15:05:46.492279 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.491919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27n6b"
Jul 26 15:05:46.493479 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.493459    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.494763 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.494738    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 26 15:05:46.494844 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.494783    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 26 15:05:46.495022 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.495005    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fz4kh\""
Jul 26 15:05:46.495367 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.495347    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 26 15:05:46.496712 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.496687    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"]
Jul 26 15:05:46.497123 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.497103    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 26 15:05:46.497365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.497346    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8qc59\""
Jul 26 15:05:46.497469 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.497414    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 26 15:05:46.506521 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.506499    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27n6b"]
Jul 26 15:05:46.507330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.507305    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dbp9s"]
Jul 26 15:05:46.640468 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.640586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac29b5e-ef15-44d2-8dba-37d77bf721d0-tmp-dir\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.640586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwg8d\" (UniqueName: \"kubernetes.io/projected/fac29b5e-ef15-44d2-8dba-37d77bf721d0-kube-api-access-jwg8d\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.640586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-certificates\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.640586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-installation-pull-secrets\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.640586 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-bound-sa-token\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.640790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-trusted-ca\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.640790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:46.640790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-image-registry-private-configuration\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.640790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a387e55-c562-43a9-a8dd-9df96a930415-cert\") pod \"ingress-canary-27n6b\" (UID: \"2a387e55-c562-43a9-a8dd-9df96a930415\") " pod="openshift-ingress-canary/ingress-canary-27n6b"
Jul 26 15:05:46.640790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr9wr\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-kube-api-access-mr9wr\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.640790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxdrq\" (UniqueName: \"kubernetes.io/projected/2a387e55-c562-43a9-a8dd-9df96a930415-kube-api-access-sxdrq\") pod \"ingress-canary-27n6b\" (UID: \"2a387e55-c562-43a9-a8dd-9df96a930415\") " pod="openshift-ingress-canary/ingress-canary-27n6b"
Jul 26 15:05:46.641076 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21324742-b811-4978-95f6-b05e4608d1ca-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:46.641076 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56875603-c25a-4d16-a4c4-7ed403a427ad-ca-trust-extracted\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.641076 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.641076 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.640863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fac29b5e-ef15-44d2-8dba-37d77bf721d0-config-volume\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.741820 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.741771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-bound-sa-token\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.741820 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.741805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-trusted-ca\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.742002 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.741823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:46.742002 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.741842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-image-registry-private-configuration\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.742002 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.741906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a387e55-c562-43a9-a8dd-9df96a930415-cert\") pod \"ingress-canary-27n6b\" (UID: \"2a387e55-c562-43a9-a8dd-9df96a930415\") " pod="openshift-ingress-canary/ingress-canary-27n6b"
Jul 26 15:05:46.742002 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.741942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9wr\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-kube-api-access-mr9wr\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.742002 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.741966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxdrq\" (UniqueName: \"kubernetes.io/projected/2a387e55-c562-43a9-a8dd-9df96a930415-kube-api-access-sxdrq\") pod \"ingress-canary-27n6b\" (UID: \"2a387e55-c562-43a9-a8dd-9df96a930415\") " pod="openshift-ingress-canary/ingress-canary-27n6b"
Jul 26 15:05:46.742002 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:46.741974    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:05:46.742002 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.741987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21324742-b811-4978-95f6-b05e4608d1ca-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56875603-c25a-4d16-a4c4-7ed403a427ad-ca-trust-extracted\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:46.742047    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:05:47.242027167 +0000 UTC m=+36.615076940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fac29b5e-ef15-44d2-8dba-37d77bf721d0-config-volume\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac29b5e-ef15-44d2-8dba-37d77bf721d0-tmp-dir\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwg8d\" (UniqueName: \"kubernetes.io/projected/fac29b5e-ef15-44d2-8dba-37d77bf721d0-kube-api-access-jwg8d\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-certificates\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-installation-pull-secrets\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:46.742307    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:05:46.742330 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:46.742324    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:05:46.742850 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:46.742375    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:05:47.242358771 +0000 UTC m=+36.615408546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:05:46.742850 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56875603-c25a-4d16-a4c4-7ed403a427ad-ca-trust-extracted\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.742850 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:46.742527    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:05:46.742850 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:46.742576    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:47.242562629 +0000 UTC m=+36.615612389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:05:46.742850 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.742789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac29b5e-ef15-44d2-8dba-37d77bf721d0-tmp-dir\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.743114 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.743054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-certificates\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.743114 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.743074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fac29b5e-ef15-44d2-8dba-37d77bf721d0-config-volume\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.743114 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.743079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-trusted-ca\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.743255 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.743235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/21324742-b811-4978-95f6-b05e4608d1ca-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:46.745984 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.745968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-installation-pull-secrets\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.746044 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.745985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2a387e55-c562-43a9-a8dd-9df96a930415-cert\") pod \"ingress-canary-27n6b\" (UID: \"2a387e55-c562-43a9-a8dd-9df96a930415\") " pod="openshift-ingress-canary/ingress-canary-27n6b"
Jul 26 15:05:46.746044 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.746011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-image-registry-private-configuration\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.753049 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.753026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxdrq\" (UniqueName: \"kubernetes.io/projected/2a387e55-c562-43a9-a8dd-9df96a930415-kube-api-access-sxdrq\") pod \"ingress-canary-27n6b\" (UID: \"2a387e55-c562-43a9-a8dd-9df96a930415\") " pod="openshift-ingress-canary/ingress-canary-27n6b"
Jul 26 15:05:46.753425 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.753406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr9wr\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-kube-api-access-mr9wr\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.754272 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.754250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwg8d\" (UniqueName: \"kubernetes.io/projected/fac29b5e-ef15-44d2-8dba-37d77bf721d0-kube-api-access-jwg8d\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:46.754351 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.754327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-bound-sa-token\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:46.809826 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.809807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27n6b"
Jul 26 15:05:46.935968 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:46.935924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27n6b"]
Jul 26 15:05:46.939371 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:05:46.939351    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a387e55_c562_43a9_a8dd_9df96a930415.slice/crio-51b366b37d5f1126a1ba4942595b9149e414026ef1ad6b7c7d820481dcea8095 WatchSource:0}: Error finding container 51b366b37d5f1126a1ba4942595b9149e414026ef1ad6b7c7d820481dcea8095: Status 404 returned error can't find the container with id 51b366b37d5f1126a1ba4942595b9149e414026ef1ad6b7c7d820481dcea8095
Jul 26 15:05:47.154054 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.154023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:05:47.154522 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.154034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:05:47.157044 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.157024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 15:05:47.157172 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.157087    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4dzfg\""
Jul 26 15:05:47.157239 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.157212    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 15:05:47.157290 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.157265    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tgnb2\""
Jul 26 15:05:47.158052 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.158036    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 15:05:47.246775 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.246745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:47.246910 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.246812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:47.246910 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.246831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:47.246910 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:47.246881    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:05:47.247027 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:47.246950    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:05:47.247027 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:47.246962    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:05:47.247027 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:47.246951    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:05:47.247027 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:47.246955    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:05:48.246938113 +0000 UTC m=+37.619987870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:05:47.247154 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:47.247038    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:05:48.247020451 +0000 UTC m=+37.620070218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:05:47.247154 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:47.247050    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:48.247044745 +0000 UTC m=+37.620094505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:05:47.446326 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.446259    2580 generic.go:356] "Generic (PLEG): container finished" podID="78c12206-8ddd-4769-9dc7-aa312103e616" containerID="0f9885156a16d360f3aa89b5c7a3ecac97bbf079a57672385fd9640bf6a30fc1" exitCode=0
Jul 26 15:05:47.446432 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.446348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" event={"ID":"78c12206-8ddd-4769-9dc7-aa312103e616","Type":"ContainerDied","Data":"0f9885156a16d360f3aa89b5c7a3ecac97bbf079a57672385fd9640bf6a30fc1"}
Jul 26 15:05:47.447544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:47.447318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27n6b" event={"ID":"2a387e55-c562-43a9-a8dd-9df96a930415","Type":"ContainerStarted","Data":"51b366b37d5f1126a1ba4942595b9149e414026ef1ad6b7c7d820481dcea8095"}
Jul 26 15:05:48.154315 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:48.154280    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:05:48.157532 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:48.157505    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 15:05:48.256282 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:48.256244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:48.256429 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:48.256294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:48.256429 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:48.256354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:48.256429 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:48.256380    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:05:48.256604 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:48.256436    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:05:48.256604 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:48.256450    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:05:48.256604 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:48.256452    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:50.256430717 +0000 UTC m=+39.629480490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:05:48.256604 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:48.256461    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:05:48.256604 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:48.256491    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:05:50.256481345 +0000 UTC m=+39.629531136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:05:48.256604 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:48.256519    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:05:50.256503884 +0000 UTC m=+39.629553646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:05:48.454649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:48.454564    2580 generic.go:356] "Generic (PLEG): container finished" podID="78c12206-8ddd-4769-9dc7-aa312103e616" containerID="e1e87f90d80eefd15bb1a6450c1089b25124ea2a865574618874b8e5a4dc9635" exitCode=0
Jul 26 15:05:48.454649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:48.454635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" event={"ID":"78c12206-8ddd-4769-9dc7-aa312103e616","Type":"ContainerDied","Data":"e1e87f90d80eefd15bb1a6450c1089b25124ea2a865574618874b8e5a4dc9635"}
Jul 26 15:05:49.462232 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:49.462013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" event={"ID":"78c12206-8ddd-4769-9dc7-aa312103e616","Type":"ContainerStarted","Data":"749762529fea8f16341555f96100bff1149bdc2fcff1a2775ec93470215d8688"}
Jul 26 15:05:49.486289 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:49.486159    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8gzmk" podStartSLOduration=9.108136515 podStartE2EDuration="38.486139447s" totalImagesPullingTime="29.378002932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:49.484383552 +0000 UTC m=+38.857433332" watchObservedRunningTime="2026-07-26 15:05:49.486139447 +0000 UTC m=+38.859189229"
Jul 26 15:05:50.271291 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:50.271209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:50.271444 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:50.271300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:50.271444 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:50.271323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:50.271444 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:50.271357    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:05:50.271444 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:50.271413    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:05:50.271444 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:50.271423    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:05:50.271444 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:50.271425    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:05:54.271409679 +0000 UTC m=+43.644459436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:05:50.271444 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:50.271427    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:05:50.271646 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:50.271458    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:05:54.271447374 +0000 UTC m=+43.644497159 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:05:50.271646 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:50.271470    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:05:54.271464147 +0000 UTC m=+43.644513904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:05:50.465768 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:50.465735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27n6b" event={"ID":"2a387e55-c562-43a9-a8dd-9df96a930415","Type":"ContainerStarted","Data":"24a3920f5fb4994cb9b51c43b50dcc73dc800bb53184d57ec621b37b4373e089"}
Jul 26 15:05:50.482631 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:50.482590    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-27n6b" podStartSLOduration=1.6417300049999999 podStartE2EDuration="4.482576492s" totalImagesPullingTime="2.840846487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:05:50.48094709 +0000 UTC m=+39.853996870" watchObservedRunningTime="2026-07-26 15:05:50.482576492 +0000 UTC m=+39.855626319"
Jul 26 15:05:54.298120 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:54.298073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:05:54.298120 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:54.298122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:05:54.298551 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:05:54.298159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:05:54.298551 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:54.298212    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:05:54.298551 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:54.298263    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:05:54.298551 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:54.298268    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:05:54.298551 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:54.298283    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:05:54.298551 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:54.298285    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:06:02.298266665 +0000 UTC m=+51.671316443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:05:54.298551 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:54.298332    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:06:02.298319207 +0000 UTC m=+51.671368967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:05:54.298551 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:05:54.298343    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:06:02.298335771 +0000 UTC m=+51.671385528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:06:02.352160 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:02.352104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:02.352166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:02.352225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:02.352280    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:02.352332    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:02.352350    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:06:18.352330982 +0000 UTC m=+67.725380742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:02.352352    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:02.352377    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:02.352388    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:06:18.352378936 +0000 UTC m=+67.725428692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:06:02.352642 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:02.352412    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:06:18.352402265 +0000 UTC m=+67.725452029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:06:11.440117 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:11.440087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h2bwn"
Jul 26 15:06:16.855940 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:16.855869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:06:16.859075 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:16.859047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 15:06:16.870207 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:16.870184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/204ac6d8-66c3-429a-890c-c1765678937c-original-pull-secret\") pod \"global-pull-secret-syncer-vsgfc\" (UID: \"204ac6d8-66c3-429a-890c-c1765678937c\") " pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:06:16.957065 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:16.957033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:06:16.960472 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:16.960453    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 15:06:16.964970 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:16.964956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vsgfc"
Jul 26 15:06:16.968205 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:16.968187    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 26 15:06:16.968262 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:16.968253    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:07:20.968237755 +0000 UTC m=+130.341287512 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : secret "metrics-daemon-secret" not found
Jul 26 15:06:17.057645 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.057608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:06:17.061108 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.061017    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 15:06:17.071136 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.071112    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 15:06:17.081549 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.081528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w86gl\" (UniqueName: \"kubernetes.io/projected/5e232b50-3a62-4dd7-808b-98084260487d-kube-api-access-w86gl\") pod \"network-check-target-hg7b2\" (UID: \"5e232b50-3a62-4dd7-808b-98084260487d\") " pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:06:17.103733 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.103701    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vsgfc"]
Jul 26 15:06:17.107118 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:06:17.107071    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204ac6d8_66c3_429a_890c_c1765678937c.slice/crio-e2f7c021cab2e593e5fa0b159f7f05b6f96a9a5e79da0d8f0be676f0f6a3a4a0 WatchSource:0}: Error finding container e2f7c021cab2e593e5fa0b159f7f05b6f96a9a5e79da0d8f0be676f0f6a3a4a0: Status 404 returned error can't find the container with id e2f7c021cab2e593e5fa0b159f7f05b6f96a9a5e79da0d8f0be676f0f6a3a4a0
Jul 26 15:06:17.171863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.171840    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4dzfg\""
Jul 26 15:06:17.179606 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.179579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:06:17.292314 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.292188    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hg7b2"]
Jul 26 15:06:17.294657 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:06:17.294633    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e232b50_3a62_4dd7_808b_98084260487d.slice/crio-84c87de1e229db2d2482a4d38c5cc825e21a69ad466e2888e37ff1f8652794e5 WatchSource:0}: Error finding container 84c87de1e229db2d2482a4d38c5cc825e21a69ad466e2888e37ff1f8652794e5: Status 404 returned error can't find the container with id 84c87de1e229db2d2482a4d38c5cc825e21a69ad466e2888e37ff1f8652794e5
Jul 26 15:06:17.527033 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.527000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hg7b2" event={"ID":"5e232b50-3a62-4dd7-808b-98084260487d","Type":"ContainerStarted","Data":"84c87de1e229db2d2482a4d38c5cc825e21a69ad466e2888e37ff1f8652794e5"}
Jul 26 15:06:17.527946 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:17.527923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vsgfc" event={"ID":"204ac6d8-66c3-429a-890c-c1765678937c","Type":"ContainerStarted","Data":"e2f7c021cab2e593e5fa0b159f7f05b6f96a9a5e79da0d8f0be676f0f6a3a4a0"}
Jul 26 15:06:18.368245 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:18.368208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:18.368275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:18.368304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:18.368369    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:18.368388    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:18.368400    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:18.368426    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:18.368438    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:06:50.368418517 +0000 UTC m=+99.741468288 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:18.368478    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:06:50.368464196 +0000 UTC m=+99.741513953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:06:18.368676 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:18.368525    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:06:50.36850074 +0000 UTC m=+99.741550502 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:06:22.542353 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:22.542318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hg7b2" event={"ID":"5e232b50-3a62-4dd7-808b-98084260487d","Type":"ContainerStarted","Data":"451f3aa0d3f3b4eae5578bbd1bec3ec564d197fa091c9a92b4c9a10d3e74f5a4"}
Jul 26 15:06:22.542801 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:22.542402    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:06:22.543717 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:22.543697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vsgfc" event={"ID":"204ac6d8-66c3-429a-890c-c1765678937c","Type":"ContainerStarted","Data":"d80d2193590ef4e532679d01be7e3edefbcbf78c6f001c5312801f00a56ca599"}
Jul 26 15:06:22.557154 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:22.557105    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hg7b2" podStartSLOduration=67.063518208 podStartE2EDuration="1m11.557092054s" totalImagesPullingTime="4.493573846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:06:22.556863795 +0000 UTC m=+71.929913556" watchObservedRunningTime="2026-07-26 15:06:22.557092054 +0000 UTC m=+71.930141832"
Jul 26 15:06:22.570973 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:22.570934    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vsgfc" podStartSLOduration=66.88689345 podStartE2EDuration="1m11.570926881s" totalImagesPullingTime="4.684033431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:06:22.57062341 +0000 UTC m=+71.943673190" watchObservedRunningTime="2026-07-26 15:06:22.570926881 +0000 UTC m=+71.943976660"
Jul 26 15:06:45.449857 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.449819    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"]
Jul 26 15:06:45.454003 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.453985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.457927 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.457905    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 26 15:06:45.458056 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.457951    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 26 15:06:45.458056 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.457961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 26 15:06:45.458056 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.457978    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 26 15:06:45.462400 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.462376    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"]
Jul 26 15:06:45.573824 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.573783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmfk4\" (UniqueName: \"kubernetes.io/projected/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-kube-api-access-hmfk4\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.574018 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.573836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-tmp\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.574018 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.573932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-klusterlet-config\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.674718 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.674677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmfk4\" (UniqueName: \"kubernetes.io/projected/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-kube-api-access-hmfk4\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.674932 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.674735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-tmp\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.674932 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.674775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-klusterlet-config\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.675182 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.675160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-tmp\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.677185 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.677157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-klusterlet-config\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.682411 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.682387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmfk4\" (UniqueName: \"kubernetes.io/projected/77c63395-6f7c-4bcb-ae91-9cbcd0422bff-kube-api-access-hmfk4\") pod \"klusterlet-addon-workmgr-567c586fff-p4xzp\" (UID: \"77c63395-6f7c-4bcb-ae91-9cbcd0422bff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.762548 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.762458    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:45.881220 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:45.881188    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"]
Jul 26 15:06:45.884346 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:06:45.884322    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c63395_6f7c_4bcb_ae91_9cbcd0422bff.slice/crio-c072cf81f0ce8973c8b967f8afc79f50ff766e10a6e9ac4c11beda7081b7304c WatchSource:0}: Error finding container c072cf81f0ce8973c8b967f8afc79f50ff766e10a6e9ac4c11beda7081b7304c: Status 404 returned error can't find the container with id c072cf81f0ce8973c8b967f8afc79f50ff766e10a6e9ac4c11beda7081b7304c
Jul 26 15:06:46.603862 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:46.603823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp" event={"ID":"77c63395-6f7c-4bcb-ae91-9cbcd0422bff","Type":"ContainerStarted","Data":"c072cf81f0ce8973c8b967f8afc79f50ff766e10a6e9ac4c11beda7081b7304c"}
Jul 26 15:06:50.412996 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:50.412950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:50.413022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:50.413043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:50.413106    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:50.413135    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:50.413146    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:50.413152    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:50.413185    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:07:54.413165693 +0000 UTC m=+163.786215462 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:50.413205    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:07:54.413196077 +0000 UTC m=+163.786245834 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:06:50.413393 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:06:50.413214    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:07:54.413209504 +0000 UTC m=+163.786259260 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:06:50.616754 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:50.616714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp" event={"ID":"77c63395-6f7c-4bcb-ae91-9cbcd0422bff","Type":"ContainerStarted","Data":"88a5d2dd8ba2d350e5dbe60092deb5014497b45a835deae2502bfa01d1eb92ee"}
Jul 26 15:06:50.616942 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:50.616920    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:50.618522 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:50.618503    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:06:50.634040 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:50.633995    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp" podStartSLOduration=1.726091851 podStartE2EDuration="5.633983184s" totalImagesPullingTime="3.907891333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:06:50.632260872 +0000 UTC m=+100.005310651" watchObservedRunningTime="2026-07-26 15:06:50.633983184 +0000 UTC m=+100.007032963"
Jul 26 15:06:53.549491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:06:53.549457    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hg7b2"
Jul 26 15:07:21.032024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:07:21.031977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:07:21.032526 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:21.032138    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 26 15:07:21.032526 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:21.032213    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:23.032197232 +0000 UTC m=+252.405246989 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : secret "metrics-daemon-secret" not found
Jul 26 15:07:49.485223 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:49.485174    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" podUID="56875603-c25a-4d16-a4c4-7ed403a427ad"
Jul 26 15:07:49.503419 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:49.503394    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx" podUID="21324742-b811-4978-95f6-b05e4608d1ca"
Jul 26 15:07:49.531784 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:49.531750    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dbp9s" podUID="fac29b5e-ef15-44d2-8dba-37d77bf721d0"
Jul 26 15:07:49.750563 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:07:49.750485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:07:49.750563 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:07:49.750518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:07:49.750778 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:07:49.750629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:07:50.163835 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:50.163781    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:07:54.483487 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:07:54.483444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:07:54.483509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:07:54.483554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:54.483598    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:54.483618    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8564f8bd84-4dv75: secret "image-registry-tls" not found
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:54.483630    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:54.483596    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:54.483677    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls podName:56875603-c25a-4d16-a4c4-7ed403a427ad nodeName:}" failed. No retries permitted until 2026-07-26 15:09:56.483661565 +0000 UTC m=+285.856711337 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls") pod "image-registry-8564f8bd84-4dv75" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad") : secret "image-registry-tls" not found
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:54.483691    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls podName:fac29b5e-ef15-44d2-8dba-37d77bf721d0 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:56.483685351 +0000 UTC m=+285.856735108 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls") pod "dns-default-dbp9s" (UID: "fac29b5e-ef15-44d2-8dba-37d77bf721d0") : secret "dns-default-metrics-tls" not found
Jul 26 15:07:54.483912 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:07:54.483701    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert podName:21324742-b811-4978-95f6-b05e4608d1ca nodeName:}" failed. No retries permitted until 2026-07-26 15:09:56.483696117 +0000 UTC m=+285.856745875 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-77dcx" (UID: "21324742-b811-4978-95f6-b05e4608d1ca") : secret "networking-console-plugin-cert" not found
Jul 26 15:08:05.153862 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:08:05.153774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:08:49.891961 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:08:49.891934    2580 generic.go:356] "Generic (PLEG): container finished" podID="77c63395-6f7c-4bcb-ae91-9cbcd0422bff" containerID="88a5d2dd8ba2d350e5dbe60092deb5014497b45a835deae2502bfa01d1eb92ee" exitCode=1
Jul 26 15:08:49.892260 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:08:49.891969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp" event={"ID":"77c63395-6f7c-4bcb-ae91-9cbcd0422bff","Type":"ContainerDied","Data":"88a5d2dd8ba2d350e5dbe60092deb5014497b45a835deae2502bfa01d1eb92ee"}
Jul 26 15:08:49.892260 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:08:49.892237    2580 scope.go:117] "RemoveContainer" containerID="88a5d2dd8ba2d350e5dbe60092deb5014497b45a835deae2502bfa01d1eb92ee"
Jul 26 15:08:50.617231 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:08:50.617192    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:08:50.896070 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:08:50.895992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp" event={"ID":"77c63395-6f7c-4bcb-ae91-9cbcd0422bff","Type":"ContainerStarted","Data":"8fa3ae90e956058d541f22c9dbd44c1bf089f31165d7572454a26f3102ec3b8f"}
Jul 26 15:08:50.896482 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:08:50.896250    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:08:50.896729 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:08:50.896708    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-567c586fff-p4xzp"
Jul 26 15:09:23.092131 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:23.092087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:09:23.092627 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:23.092234    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 26 15:09:23.092627 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:23.092294    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs podName:3f03e5fc-b967-47e5-a60e-22a7a78204c6 nodeName:}" failed. No retries permitted until 2026-07-26 15:11:25.09227908 +0000 UTC m=+374.465328837 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs") pod "network-metrics-daemon-qb9cd" (UID: "3f03e5fc-b967-47e5-a60e-22a7a78204c6") : secret "metrics-daemon-secret" not found
Jul 26 15:09:36.438949 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.438869    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4"]
Jul 26 15:09:36.441463 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.441440    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-556b4c7b7-tv4sv"]
Jul 26 15:09:36.441577 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.441548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4"
Jul 26 15:09:36.443974 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.443949    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.444076 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.444021    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-r95k4\""
Jul 26 15:09:36.446735 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.446716    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 26 15:09:36.446979 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.446963    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 26 15:09:36.447061 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.447042    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-89xhg\""
Jul 26 15:09:36.447131 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.447047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 26 15:09:36.448092 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.447832    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 26 15:09:36.448092 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.447832    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 26 15:09:36.448092 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.447878    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 26 15:09:36.458735 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.458713    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4"]
Jul 26 15:09:36.459413 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.459393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-556b4c7b7-tv4sv"]
Jul 26 15:09:36.535577 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.535547    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"]
Jul 26 15:09:36.538292 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.538278    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.540849 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.540829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 26 15:09:36.540960 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.540900    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g8s7c\""
Jul 26 15:09:36.542100 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.542083    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 26 15:09:36.544128 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.544103    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 26 15:09:36.544199 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.544103    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 26 15:09:36.548118 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.548091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"]
Jul 26 15:09:36.585949 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.585924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.586055 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.585984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-stats-auth\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.586055 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.586036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp2qt\" (UniqueName: \"kubernetes.io/projected/f76b2da7-7274-4157-9e2a-19a54a266011-kube-api-access-dp2qt\") pod \"network-check-source-7d88cb55d8-9wwh4\" (UID: \"f76b2da7-7274-4157-9e2a-19a54a266011\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4"
Jul 26 15:09:36.586131 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.586082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-default-certificate\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.586131 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.586110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.586131 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.586126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx4cm\" (UniqueName: \"kubernetes.io/projected/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-kube-api-access-vx4cm\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.586224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.586162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec7778f1-0e54-465d-90ce-784c357f45f5-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.586224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.586198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6rrq\" (UniqueName: \"kubernetes.io/projected/ec7778f1-0e54-465d-90ce-784c357f45f5-kube-api-access-s6rrq\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.586224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.586218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.687217 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-stats-auth\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.687315 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp2qt\" (UniqueName: \"kubernetes.io/projected/f76b2da7-7274-4157-9e2a-19a54a266011-kube-api-access-dp2qt\") pod \"network-check-source-7d88cb55d8-9wwh4\" (UID: \"f76b2da7-7274-4157-9e2a-19a54a266011\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4"
Jul 26 15:09:36.687315 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-default-certificate\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.687315 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.687432 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx4cm\" (UniqueName: \"kubernetes.io/projected/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-kube-api-access-vx4cm\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.687432 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec7778f1-0e54-465d-90ce-784c357f45f5-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.687555 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:36.687524    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 15:09:36.687622 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6rrq\" (UniqueName: \"kubernetes.io/projected/ec7778f1-0e54-465d-90ce-784c357f45f5-kube-api-access-s6rrq\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.687622 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:36.687609    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:37.187586396 +0000 UTC m=+266.560636153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : secret "router-metrics-certs-default" not found
Jul 26 15:09:36.687739 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.687739 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.687676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.687847 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:36.687732    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:36.687847 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:36.687793    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls podName:ec7778f1-0e54-465d-90ce-784c357f45f5 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:37.187777087 +0000 UTC m=+266.560826858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-p8sb7" (UID: "ec7778f1-0e54-465d-90ce-784c357f45f5") : secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:36.687847 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:36.687839    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:37.187826152 +0000 UTC m=+266.560875923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : configmap references non-existent config key: service-ca.crt
Jul 26 15:09:36.688224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.688204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec7778f1-0e54-465d-90ce-784c357f45f5-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.689617 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.689566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-stats-auth\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.689716 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.689701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-default-certificate\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.697088 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.697061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp2qt\" (UniqueName: \"kubernetes.io/projected/f76b2da7-7274-4157-9e2a-19a54a266011-kube-api-access-dp2qt\") pod \"network-check-source-7d88cb55d8-9wwh4\" (UID: \"f76b2da7-7274-4157-9e2a-19a54a266011\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4"
Jul 26 15:09:36.700351 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.700331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx4cm\" (UniqueName: \"kubernetes.io/projected/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-kube-api-access-vx4cm\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:36.701468 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.701451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6rrq\" (UniqueName: \"kubernetes.io/projected/ec7778f1-0e54-465d-90ce-784c357f45f5-kube-api-access-s6rrq\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:36.751078 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.751045    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4"
Jul 26 15:09:36.867861 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:36.867827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4"]
Jul 26 15:09:36.870667 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:09:36.870641    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76b2da7_7274_4157_9e2a_19a54a266011.slice/crio-ef4bcd759034c11d7116a4d940ec28bd261f91e2ea73456e89b2c3bec0e3d05d WatchSource:0}: Error finding container ef4bcd759034c11d7116a4d940ec28bd261f91e2ea73456e89b2c3bec0e3d05d: Status 404 returned error can't find the container with id ef4bcd759034c11d7116a4d940ec28bd261f91e2ea73456e89b2c3bec0e3d05d
Jul 26 15:09:37.006728 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:37.006645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4" event={"ID":"f76b2da7-7274-4157-9e2a-19a54a266011","Type":"ContainerStarted","Data":"6154c3b6bb7797e094b918f560dfe3ceb8d1603669bd6c056eb47119225b2f57"}
Jul 26 15:09:37.006728 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:37.006702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4" event={"ID":"f76b2da7-7274-4157-9e2a-19a54a266011","Type":"ContainerStarted","Data":"ef4bcd759034c11d7116a4d940ec28bd261f91e2ea73456e89b2c3bec0e3d05d"}
Jul 26 15:09:37.021766 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:37.021718    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-9wwh4" podStartSLOduration=1.021706529 podStartE2EDuration="1.021706529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:09:37.021256398 +0000 UTC m=+266.394306179" watchObservedRunningTime="2026-07-26 15:09:37.021706529 +0000 UTC m=+266.394756307"
Jul 26 15:09:37.191628 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:37.191600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:37.191628 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:37.191633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:37.191864 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:37.191760    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:38.191746787 +0000 UTC m=+267.564796545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : configmap references non-existent config key: service-ca.crt
Jul 26 15:09:37.191864 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:37.191762    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:37.191864 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:37.191818    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls podName:ec7778f1-0e54-465d-90ce-784c357f45f5 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:38.191803054 +0000 UTC m=+267.564852810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-p8sb7" (UID: "ec7778f1-0e54-465d-90ce-784c357f45f5") : secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:37.191864 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:37.191849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:37.192038 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:37.191952    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 15:09:37.192038 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:37.191995    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:38.191985169 +0000 UTC m=+267.565034926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : secret "router-metrics-certs-default" not found
Jul 26 15:09:38.198406 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:38.198374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:38.198406 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:38.198411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:38.198836 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:38.198503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:38.198836 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:38.198525    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:38.198836 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:38.198588    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls podName:ec7778f1-0e54-465d-90ce-784c357f45f5 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:40.198569971 +0000 UTC m=+269.571619742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-p8sb7" (UID: "ec7778f1-0e54-465d-90ce-784c357f45f5") : secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:38.198836 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:38.198600    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 15:09:38.198836 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:38.198627    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:40.1986082 +0000 UTC m=+269.571657960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : configmap references non-existent config key: service-ca.crt
Jul 26 15:09:38.198836 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:38.198658    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:40.198648482 +0000 UTC m=+269.571698246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : secret "router-metrics-certs-default" not found
Jul 26 15:09:40.213371 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:40.213338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:40.213371 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:40.213377    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:40.213915 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:40.213493    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:40.213915 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:40.213496    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:44.213483442 +0000 UTC m=+273.586533199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : configmap references non-existent config key: service-ca.crt
Jul 26 15:09:40.213915 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:40.213582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:40.213915 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:40.213637    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls podName:ec7778f1-0e54-465d-90ce-784c357f45f5 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:44.21362592 +0000 UTC m=+273.586675680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-p8sb7" (UID: "ec7778f1-0e54-465d-90ce-784c357f45f5") : secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:40.213915 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:40.213660    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 15:09:40.213915 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:40.213720    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:44.213705649 +0000 UTC m=+273.586755421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : secret "router-metrics-certs-default" not found
Jul 26 15:09:41.025187 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.025155    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7mljx"]
Jul 26 15:09:41.028303 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.028285    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.031030 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.031007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 26 15:09:41.031153 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.031078    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 26 15:09:41.032329 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.032311    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 26 15:09:41.032400 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.032336    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 26 15:09:41.032400 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.032347    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4q6m\""
Jul 26 15:09:41.040687 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.040668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7mljx"]
Jul 26 15:09:41.120098 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.120064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d97c7d59-c3b6-4690-812c-f80b3368df12-crio-socket\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.120098 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.120100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89wfp\" (UniqueName: \"kubernetes.io/projected/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-api-access-89wfp\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.120312 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.120172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.120312 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.120276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d97c7d59-c3b6-4690-812c-f80b3368df12-data-volume\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.120312 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.120302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.221137 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.221099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.221549 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:41.221261    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:41.221549 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.221314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d97c7d59-c3b6-4690-812c-f80b3368df12-data-volume\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.221549 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:41.221345    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:41.721324061 +0000 UTC m=+271.094373824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:41.221549 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.221383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.221549 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.221416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d97c7d59-c3b6-4690-812c-f80b3368df12-crio-socket\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.221549 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.221442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89wfp\" (UniqueName: \"kubernetes.io/projected/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-api-access-89wfp\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.221549 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:41.221516    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:09:41.221549 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.221529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d97c7d59-c3b6-4690-812c-f80b3368df12-crio-socket\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.221868 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:41.221584    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:41.721569028 +0000 UTC m=+271.094618800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : configmap "kube-rbac-proxy" not found
Jul 26 15:09:41.221868 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.221638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d97c7d59-c3b6-4690-812c-f80b3368df12-data-volume\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.230801 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.230782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89wfp\" (UniqueName: \"kubernetes.io/projected/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-api-access-89wfp\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.724646 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.724606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.724830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:41.724667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:41.724830 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:41.724729    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:09:41.724830 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:41.724803    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:42.724785746 +0000 UTC m=+272.097835506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : configmap "kube-rbac-proxy" not found
Jul 26 15:09:41.725031 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:41.724847    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:41.725031 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:41.724943    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:42.724925121 +0000 UTC m=+272.097974892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:42.733210 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:42.733170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:42.733681 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:42.733349    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:42.733681 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:42.733379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:42.733681 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:42.733442    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:44.733420587 +0000 UTC m=+274.106470347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:42.733681 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:42.733461    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:09:42.733681 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:42.733509    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:44.733497444 +0000 UTC m=+274.106547201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : configmap "kube-rbac-proxy" not found
Jul 26 15:09:43.005746 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:43.005674    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rf7vx_f740f8b6-ed75-43bf-8378-be860c4d5f3f/dns-node-resolver/0.log"
Jul 26 15:09:43.805139 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:43.805111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f2dp7_91b8324b-a8e5-4108-b32b-2a378af644c0/node-ca/0.log"
Jul 26 15:09:44.044961 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.044929    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-zdzsb"]
Jul 26 15:09:44.047954 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.047933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.050681 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.050661    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 26 15:09:44.051858 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.051835    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 26 15:09:44.051964 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.051859    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6qhb8\""
Jul 26 15:09:44.051964 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.051842    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 26 15:09:44.051964 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.051937    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 26 15:09:44.057047 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.057000    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-zdzsb"]
Jul 26 15:09:44.144481 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.144451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a0f8c21d-8741-4202-b1e4-01f197a3f910-signing-key\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.144611 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.144517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a0f8c21d-8741-4202-b1e4-01f197a3f910-signing-cabundle\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.144611 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.144561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk2cq\" (UniqueName: \"kubernetes.io/projected/a0f8c21d-8741-4202-b1e4-01f197a3f910-kube-api-access-nk2cq\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.245427 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.245381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a0f8c21d-8741-4202-b1e4-01f197a3f910-signing-key\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.245584 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.245434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:44.245584 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.245463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:44.245584 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.245520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a0f8c21d-8741-4202-b1e4-01f197a3f910-signing-cabundle\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.245584 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.245573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk2cq\" (UniqueName: \"kubernetes.io/projected/a0f8c21d-8741-4202-b1e4-01f197a3f910-kube-api-access-nk2cq\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.245786 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.245601    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:44.245786 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.245620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:44.245786 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.245692    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls podName:ec7778f1-0e54-465d-90ce-784c357f45f5 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:52.245644385 +0000 UTC m=+281.618694142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-p8sb7" (UID: "ec7778f1-0e54-465d-90ce-784c357f45f5") : secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:44.245786 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.245713    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:52.245703396 +0000 UTC m=+281.618753153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : configmap references non-existent config key: service-ca.crt
Jul 26 15:09:44.245786 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.245724    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 15:09:44.245786 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.245773    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:09:52.245757907 +0000 UTC m=+281.618807665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : secret "router-metrics-certs-default" not found
Jul 26 15:09:44.246211 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.246192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a0f8c21d-8741-4202-b1e4-01f197a3f910-signing-cabundle\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.247744 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.247727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a0f8c21d-8741-4202-b1e4-01f197a3f910-signing-key\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.253631 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.253613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk2cq\" (UniqueName: \"kubernetes.io/projected/a0f8c21d-8741-4202-b1e4-01f197a3f910-kube-api-access-nk2cq\") pod \"service-ca-658d7b7c78-zdzsb\" (UID: \"a0f8c21d-8741-4202-b1e4-01f197a3f910\") " pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.356664 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.356570    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb"
Jul 26 15:09:44.477294 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.477263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-zdzsb"]
Jul 26 15:09:44.480403 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:09:44.480373    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f8c21d_8741_4202_b1e4_01f197a3f910.slice/crio-5159e2a918277d1c7fd8d4b1b66978af1cd8a2fc9c97499b5c12816abbd7714e WatchSource:0}: Error finding container 5159e2a918277d1c7fd8d4b1b66978af1cd8a2fc9c97499b5c12816abbd7714e: Status 404 returned error can't find the container with id 5159e2a918277d1c7fd8d4b1b66978af1cd8a2fc9c97499b5c12816abbd7714e
Jul 26 15:09:44.607789 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.607727    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27n6b_2a387e55-c562-43a9-a8dd-9df96a930415/serve-healthcheck-canary/0.log"
Jul 26 15:09:44.748474 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.748443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:44.748601 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:44.748497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:44.748601 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.748561    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:09:44.748683 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.748617    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:48.748602969 +0000 UTC m=+278.121652726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : configmap "kube-rbac-proxy" not found
Jul 26 15:09:44.748683 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.748631    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:44.748683 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:44.748672    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:48.748656929 +0000 UTC m=+278.121706691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:45.035065 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:45.035029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb" event={"ID":"a0f8c21d-8741-4202-b1e4-01f197a3f910","Type":"ContainerStarted","Data":"5159e2a918277d1c7fd8d4b1b66978af1cd8a2fc9c97499b5c12816abbd7714e"}
Jul 26 15:09:47.046617 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:47.046566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb" event={"ID":"a0f8c21d-8741-4202-b1e4-01f197a3f910","Type":"ContainerStarted","Data":"7453e19f00df50b4d5b1868f4ce0b93fb8ba794ea464c56151e19332e416dad9"}
Jul 26 15:09:47.064627 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:47.064582    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-zdzsb" podStartSLOduration=1.357086815 podStartE2EDuration="3.064568893s" totalImagesPullingTime="1.707482078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:09:47.063868401 +0000 UTC m=+276.436918182" watchObservedRunningTime="2026-07-26 15:09:47.064568893 +0000 UTC m=+276.437618671"
Jul 26 15:09:48.785058 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:48.785019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:48.785463 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:48.785080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:48.785463 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:48.785143    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:09:48.785463 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:48.785166    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:48.785463 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:48.785207    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:56.78519252 +0000 UTC m=+286.158242278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : configmap "kube-rbac-proxy" not found
Jul 26 15:09:48.785463 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:48.785222    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:09:56.785216091 +0000 UTC m=+286.158265847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:52.311135 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:52.311100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:52.311565 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:52.311172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:09:52.311565 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:52.311192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:09:52.311565 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:52.311242    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 26 15:09:52.311565 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:52.311304    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:52.311565 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:52.311313    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:10:08.311293801 +0000 UTC m=+297.684343561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : secret "router-metrics-certs-default" not found
Jul 26 15:09:52.311565 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:52.311362    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle podName:4182d614-6a3c-4799-ab6c-8d497ff0b9ff nodeName:}" failed. No retries permitted until 2026-07-26 15:10:08.311343559 +0000 UTC m=+297.684393337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle") pod "router-default-556b4c7b7-tv4sv" (UID: "4182d614-6a3c-4799-ab6c-8d497ff0b9ff") : configmap references non-existent config key: service-ca.crt
Jul 26 15:09:52.311565 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:52.311401    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls podName:ec7778f1-0e54-465d-90ce-784c357f45f5 nodeName:}" failed. No retries permitted until 2026-07-26 15:10:08.311389759 +0000 UTC m=+297.684439518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-p8sb7" (UID: "ec7778f1-0e54-465d-90ce-784c357f45f5") : secret "cluster-monitoring-operator-tls" not found
Jul 26 15:09:52.750984 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:52.750871    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" podUID="56875603-c25a-4d16-a4c4-7ed403a427ad"
Jul 26 15:09:52.751123 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:52.751019    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx" podUID="21324742-b811-4978-95f6-b05e4608d1ca"
Jul 26 15:09:52.751188 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:52.751163    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dbp9s" podUID="fac29b5e-ef15-44d2-8dba-37d77bf721d0"
Jul 26 15:09:53.063283 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:53.063249    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:09:53.063283 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:53.063274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:09:53.063482 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:53.063437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:09:56.546618 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.546579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:09:56.546618 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.546622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:09:56.547144 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.546649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:09:56.548998 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.548970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21324742-b811-4978-95f6-b05e4608d1ca-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-77dcx\" (UID: \"21324742-b811-4978-95f6-b05e4608d1ca\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:09:56.549104 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.548998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"image-registry-8564f8bd84-4dv75\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") " pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:09:56.549104 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.549025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fac29b5e-ef15-44d2-8dba-37d77bf721d0-metrics-tls\") pod \"dns-default-dbp9s\" (UID: \"fac29b5e-ef15-44d2-8dba-37d77bf721d0\") " pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:09:56.666603 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.666571    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8qc59\""
Jul 26 15:09:56.668186 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.668169    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sm44q\""
Jul 26 15:09:56.668253 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.668240    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qhrv\""
Jul 26 15:09:56.674812 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.674794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"
Jul 26 15:09:56.674868 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.674812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:09:56.674922 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.674869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:09:56.820977 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.820944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-77dcx"]
Jul 26 15:09:56.828961 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:09:56.828935    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21324742_b811_4978_95f6_b05e4608d1ca.slice/crio-558e6fc4adac2078672f806238196c4ac80f16fcddcf5ede27324793eafe8970 WatchSource:0}: Error finding container 558e6fc4adac2078672f806238196c4ac80f16fcddcf5ede27324793eafe8970: Status 404 returned error can't find the container with id 558e6fc4adac2078672f806238196c4ac80f16fcddcf5ede27324793eafe8970
Jul 26 15:09:56.838156 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.838130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dbp9s"]
Jul 26 15:09:56.840432 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:09:56.840409    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac29b5e_ef15_44d2_8dba_37d77bf721d0.slice/crio-96f206749a28ee3f9e7c7c62027e60260c5a261d00df976af8235d57f24d5fc7 WatchSource:0}: Error finding container 96f206749a28ee3f9e7c7c62027e60260c5a261d00df976af8235d57f24d5fc7: Status 404 returned error can't find the container with id 96f206749a28ee3f9e7c7c62027e60260c5a261d00df976af8235d57f24d5fc7
Jul 26 15:09:56.849123 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.849100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:56.849214 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.849167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:56.849288 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:56.849267    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:56.849361 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:09:56.849342    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls podName:d97c7d59-c3b6-4690-812c-f80b3368df12 nodeName:}" failed. No retries permitted until 2026-07-26 15:10:12.849319554 +0000 UTC m=+302.222369326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mljx" (UID: "d97c7d59-c3b6-4690-812c-f80b3368df12") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:09:56.849738 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.849717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d97c7d59-c3b6-4690-812c-f80b3368df12-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:09:56.858185 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:56.858165    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8564f8bd84-4dv75"]
Jul 26 15:09:56.861236 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:09:56.861210    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56875603_c25a_4d16_a4c4_7ed403a427ad.slice/crio-fa572c66ad261792506c6d4b35f1bc260f0bc7a81cf21ab90c311235c3e92085 WatchSource:0}: Error finding container fa572c66ad261792506c6d4b35f1bc260f0bc7a81cf21ab90c311235c3e92085: Status 404 returned error can't find the container with id fa572c66ad261792506c6d4b35f1bc260f0bc7a81cf21ab90c311235c3e92085
Jul 26 15:09:57.075876 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:57.075788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" event={"ID":"56875603-c25a-4d16-a4c4-7ed403a427ad","Type":"ContainerStarted","Data":"ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f"}
Jul 26 15:09:57.075876 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:57.075834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" event={"ID":"56875603-c25a-4d16-a4c4-7ed403a427ad","Type":"ContainerStarted","Data":"fa572c66ad261792506c6d4b35f1bc260f0bc7a81cf21ab90c311235c3e92085"}
Jul 26 15:09:57.076120 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:57.075907    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:09:57.077086 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:57.077054    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dbp9s" event={"ID":"fac29b5e-ef15-44d2-8dba-37d77bf721d0","Type":"ContainerStarted","Data":"96f206749a28ee3f9e7c7c62027e60260c5a261d00df976af8235d57f24d5fc7"}
Jul 26 15:09:57.078177 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:57.078154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx" event={"ID":"21324742-b811-4978-95f6-b05e4608d1ca","Type":"ContainerStarted","Data":"558e6fc4adac2078672f806238196c4ac80f16fcddcf5ede27324793eafe8970"}
Jul 26 15:09:57.095435 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:57.095392    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" podStartSLOduration=286.09537816 podStartE2EDuration="4m46.09537816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:09:57.093730039 +0000 UTC m=+286.466779831" watchObservedRunningTime="2026-07-26 15:09:57.09537816 +0000 UTC m=+286.468428002"
Jul 26 15:09:58.087604 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:58.087565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx" event={"ID":"21324742-b811-4978-95f6-b05e4608d1ca","Type":"ContainerStarted","Data":"221320f659d081b7e02a4a1b1dfe7697c07f0a1dd1b2a3f7591d7517fd2973fe"}
Jul 26 15:09:58.104913 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:58.104847    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-77dcx" podStartSLOduration=261.021195282 podStartE2EDuration="4m22.104832771s" totalImagesPullingTime="1.083637489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:09:58.104351683 +0000 UTC m=+287.477401463" watchObservedRunningTime="2026-07-26 15:09:58.104832771 +0000 UTC m=+287.477882579"
Jul 26 15:09:59.092019 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:59.091983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dbp9s" event={"ID":"fac29b5e-ef15-44d2-8dba-37d77bf721d0","Type":"ContainerStarted","Data":"0da5156bd4f429a7ccbf50afeb7c2213c561cba432315a02602bcf1f2383e3ec"}
Jul 26 15:09:59.092486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:59.092035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dbp9s" event={"ID":"fac29b5e-ef15-44d2-8dba-37d77bf721d0","Type":"ContainerStarted","Data":"d2b685efa7b9eb6c3169c6bd59423bd685d2cfc4d574fbd9d7cea34841cb7f53"}
Jul 26 15:09:59.108493 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:09:59.108450    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dbp9s" podStartSLOduration=251.474550081 podStartE2EDuration="4m13.108435763s" totalImagesPullingTime="1.633885682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:09:59.107727109 +0000 UTC m=+288.480776887" watchObservedRunningTime="2026-07-26 15:09:59.108435763 +0000 UTC m=+288.481485543"
Jul 26 15:10:00.095975 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:00.095947    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:10:08.155160 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:10:08.155113    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qb9cd" podUID="3f03e5fc-b967-47e5-a60e-22a7a78204c6"
Jul 26 15:10:08.343388 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.343350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:08.343538 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.343408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:10:08.343538 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.343430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:08.344040 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.344017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-service-ca-bundle\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:08.345793 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.345774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4182d614-6a3c-4799-ab6c-8d497ff0b9ff-metrics-certs\") pod \"router-default-556b4c7b7-tv4sv\" (UID: \"4182d614-6a3c-4799-ab6c-8d497ff0b9ff\") " pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:08.345850 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.345802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec7778f1-0e54-465d-90ce-784c357f45f5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-p8sb7\" (UID: \"ec7778f1-0e54-465d-90ce-784c357f45f5\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:10:08.346599 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.346578    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"
Jul 26 15:10:08.469040 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.469008    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7"]
Jul 26 15:10:08.472926 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:08.472883    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7778f1_0e54_465d_90ce_784c357f45f5.slice/crio-4e1ff3d9330ad32a3428571bb3daba8f88101823213418ecce4b68623b73bae6 WatchSource:0}: Error finding container 4e1ff3d9330ad32a3428571bb3daba8f88101823213418ecce4b68623b73bae6: Status 404 returned error can't find the container with id 4e1ff3d9330ad32a3428571bb3daba8f88101823213418ecce4b68623b73bae6
Jul 26 15:10:08.556563 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.556533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:08.679480 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:08.679452    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-556b4c7b7-tv4sv"]
Jul 26 15:10:08.681496 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:08.681471    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4182d614_6a3c_4799_ab6c_8d497ff0b9ff.slice/crio-3b51adb7ef2645f56de10d3cadbc104c3ea0275bfbf11c553e0642d0b6cb242e WatchSource:0}: Error finding container 3b51adb7ef2645f56de10d3cadbc104c3ea0275bfbf11c553e0642d0b6cb242e: Status 404 returned error can't find the container with id 3b51adb7ef2645f56de10d3cadbc104c3ea0275bfbf11c553e0642d0b6cb242e
Jul 26 15:10:09.123297 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:09.123259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-556b4c7b7-tv4sv" event={"ID":"4182d614-6a3c-4799-ab6c-8d497ff0b9ff","Type":"ContainerStarted","Data":"759277f67f4dd8db6348d944806d0bcecea7f43a43afb0d70ae1ae31775ceab3"}
Jul 26 15:10:09.123486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:09.123311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-556b4c7b7-tv4sv" event={"ID":"4182d614-6a3c-4799-ab6c-8d497ff0b9ff","Type":"ContainerStarted","Data":"3b51adb7ef2645f56de10d3cadbc104c3ea0275bfbf11c553e0642d0b6cb242e"}
Jul 26 15:10:09.124347 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:09.124327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7" event={"ID":"ec7778f1-0e54-465d-90ce-784c357f45f5","Type":"ContainerStarted","Data":"4e1ff3d9330ad32a3428571bb3daba8f88101823213418ecce4b68623b73bae6"}
Jul 26 15:10:09.142378 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:09.142331    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-556b4c7b7-tv4sv" podStartSLOduration=33.1423144 podStartE2EDuration="33.1423144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:09.14152879 +0000 UTC m=+298.514578583" watchObservedRunningTime="2026-07-26 15:10:09.1423144 +0000 UTC m=+298.515364179"
Jul 26 15:10:09.558012 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:09.557958    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:09.561001 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:09.560970    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:10.101382 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:10.101352    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dbp9s"
Jul 26 15:10:10.133440 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:10.133400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:10.134627 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:10.134605    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-556b4c7b7-tv4sv"
Jul 26 15:10:11.060398 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:11.060310    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 26 15:10:11.138216 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:11.138043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7" event={"ID":"ec7778f1-0e54-465d-90ce-784c357f45f5","Type":"ContainerStarted","Data":"09213e5956bee6da71d3473ff3b3fc9f7d9220d4544e0e06d05d3494fbd96dac"}
Jul 26 15:10:11.161166 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:11.155111    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-p8sb7" podStartSLOduration=32.837530147 podStartE2EDuration="35.15509262s" totalImagesPullingTime="2.317562473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:11.152933053 +0000 UTC m=+300.525982832" watchObservedRunningTime="2026-07-26 15:10:11.15509262 +0000 UTC m=+300.528142401"
Jul 26 15:10:12.878473 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:12.878433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:10:12.880763 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:12.880736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d97c7d59-c3b6-4690-812c-f80b3368df12-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mljx\" (UID: \"d97c7d59-c3b6-4690-812c-f80b3368df12\") " pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:10:13.140394 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.140305    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4q6m\""
Jul 26 15:10:13.148228 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.148197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7mljx"
Jul 26 15:10:13.299539 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.299508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7mljx"]
Jul 26 15:10:13.302714 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:13.302684    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97c7d59_c3b6_4690_812c_f80b3368df12.slice/crio-86e824265347f1b664e57e8e3fcf2e61e1730162b3b3170b302a6ba866394c6d WatchSource:0}: Error finding container 86e824265347f1b664e57e8e3fcf2e61e1730162b3b3170b302a6ba866394c6d: Status 404 returned error can't find the container with id 86e824265347f1b664e57e8e3fcf2e61e1730162b3b3170b302a6ba866394c6d
Jul 26 15:10:13.304082 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.304064    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:10:13.307048 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.307025    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"]
Jul 26 15:10:13.311412 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.311386    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.313801 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.313776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 26 15:10:13.314077 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.314052    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 26 15:10:13.314177 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.314097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wj89b\""
Jul 26 15:10:13.314177 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.314118    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 26 15:10:13.317220 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.317200    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"]
Jul 26 15:10:13.381634 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.381600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e40d687-dd9d-4421-b64e-a022589f34a0-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.381634 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.381640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d66r\" (UniqueName: \"kubernetes.io/projected/8e40d687-dd9d-4421-b64e-a022589f34a0-kube-api-access-2d66r\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.381854 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.381681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.381854 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.381699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.482610 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.482518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.482610 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.482553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.482610 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.482603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e40d687-dd9d-4421-b64e-a022589f34a0-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.482916 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.482623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d66r\" (UniqueName: \"kubernetes.io/projected/8e40d687-dd9d-4421-b64e-a022589f34a0-kube-api-access-2d66r\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.482916 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:10:13.482671    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 26 15:10:13.482916 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:10:13.482763    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-tls podName:8e40d687-dd9d-4421-b64e-a022589f34a0 nodeName:}" failed. No retries permitted until 2026-07-26 15:10:13.98274135 +0000 UTC m=+303.355791125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-kjx9x" (UID: "8e40d687-dd9d-4421-b64e-a022589f34a0") : secret "prometheus-operator-tls" not found
Jul 26 15:10:13.483310 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.483294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e40d687-dd9d-4421-b64e-a022589f34a0-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.484877 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.484858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.491288 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.491267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d66r\" (UniqueName: \"kubernetes.io/projected/8e40d687-dd9d-4421-b64e-a022589f34a0-kube-api-access-2d66r\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.985772 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.985730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:13.989826 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:13.989798    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8e40d687-dd9d-4421-b64e-a022589f34a0-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-kjx9x\" (UID: \"8e40d687-dd9d-4421-b64e-a022589f34a0\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:14.149127 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:14.149088    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mljx" event={"ID":"d97c7d59-c3b6-4690-812c-f80b3368df12","Type":"ContainerStarted","Data":"86e824265347f1b664e57e8e3fcf2e61e1730162b3b3170b302a6ba866394c6d"}
Jul 26 15:10:14.221786 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:14.221737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"
Jul 26 15:10:14.365103 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:14.365073    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-kjx9x"]
Jul 26 15:10:14.367759 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:14.367729    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e40d687_dd9d_4421_b64e_a022589f34a0.slice/crio-4ce0db09f2104ec4032dde7728c66c9608962b79a4807233ac42f3c95aec3c33 WatchSource:0}: Error finding container 4ce0db09f2104ec4032dde7728c66c9608962b79a4807233ac42f3c95aec3c33: Status 404 returned error can't find the container with id 4ce0db09f2104ec4032dde7728c66c9608962b79a4807233ac42f3c95aec3c33
Jul 26 15:10:15.061685 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.061650    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f849c67cb-2r6x5"]
Jul 26 15:10:15.065083 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.065056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.068082 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.068044    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r8ctd\""
Jul 26 15:10:15.068224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.068088    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 26 15:10:15.068224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.068045    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 26 15:10:15.068368 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.068044    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 26 15:10:15.069287 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.069263    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 26 15:10:15.069405 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.069356    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 26 15:10:15.069405 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.069396    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 26 15:10:15.069502 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.069467    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 26 15:10:15.076004 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.075743    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 26 15:10:15.076304 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.076279    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f849c67cb-2r6x5"]
Jul 26 15:10:15.096292 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.096255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-serving-cert\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.096479 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.096320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-service-ca\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.096479 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.096433    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-trusted-ca-bundle\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.096611 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.096484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-oauth-serving-cert\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.096611 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.096527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-oauth-config\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.096611 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.096553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-console-config\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.096611 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.096568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x446h\" (UniqueName: \"kubernetes.io/projected/a463c219-6b44-4b6a-a714-42ec58a3701a-kube-api-access-x446h\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.158961 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.158925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x" event={"ID":"8e40d687-dd9d-4421-b64e-a022589f34a0","Type":"ContainerStarted","Data":"4ce0db09f2104ec4032dde7728c66c9608962b79a4807233ac42f3c95aec3c33"}
Jul 26 15:10:15.197602 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.197566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-trusted-ca-bundle\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.197781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.197633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-oauth-serving-cert\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.197781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.197668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-oauth-config\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.197781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.197699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-console-config\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.197781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.197732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x446h\" (UniqueName: \"kubernetes.io/projected/a463c219-6b44-4b6a-a714-42ec58a3701a-kube-api-access-x446h\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.197781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.197777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-serving-cert\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.198063 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.197817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-service-ca\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.198554 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.198485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-oauth-serving-cert\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.199184 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.199158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-console-config\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.199306 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.199158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-service-ca\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.199842 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.199820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-trusted-ca-bundle\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.200922 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.200855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-oauth-config\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.201701 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.201677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-serving-cert\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.206056 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.206030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x446h\" (UniqueName: \"kubernetes.io/projected/a463c219-6b44-4b6a-a714-42ec58a3701a-kube-api-access-x446h\") pod \"console-5f849c67cb-2r6x5\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") " pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.378355 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.378273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:15.525596 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:15.525562    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f849c67cb-2r6x5"]
Jul 26 15:10:15.755507 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:15.755424    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda463c219_6b44_4b6a_a714_42ec58a3701a.slice/crio-57cc4e8d5c85ae1e8e81478eca1ab52e9515189929446fb240d97719c534acde WatchSource:0}: Error finding container 57cc4e8d5c85ae1e8e81478eca1ab52e9515189929446fb240d97719c534acde: Status 404 returned error can't find the container with id 57cc4e8d5c85ae1e8e81478eca1ab52e9515189929446fb240d97719c534acde
Jul 26 15:10:16.164054 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:16.164012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f849c67cb-2r6x5" event={"ID":"a463c219-6b44-4b6a-a714-42ec58a3701a","Type":"ContainerStarted","Data":"57cc4e8d5c85ae1e8e81478eca1ab52e9515189929446fb240d97719c534acde"}
Jul 26 15:10:16.679771 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:16.679730    2580 patch_prober.go:28] interesting pod/image-registry-8564f8bd84-4dv75 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 26 15:10:16.679977 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:16.679799    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" podUID="56875603-c25a-4d16-a4c4-7ed403a427ad" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 15:10:18.094801 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:18.094719    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:10:19.154038 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:19.154005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:10:19.178104 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:19.178062    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mljx" event={"ID":"d97c7d59-c3b6-4690-812c-f80b3368df12","Type":"ContainerStarted","Data":"25f63ff67135da8f30b76929153f6cbc4eba67bce6475cbdfb50859fd9f0cabf"}
Jul 26 15:10:19.179969 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:19.179938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x" event={"ID":"8e40d687-dd9d-4421-b64e-a022589f34a0","Type":"ContainerStarted","Data":"0921e66a893dddd2e0db97a50516ab955b5502df4e44a338c2b24329db296f8c"}
Jul 26 15:10:19.180086 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:19.179995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x" event={"ID":"8e40d687-dd9d-4421-b64e-a022589f34a0","Type":"ContainerStarted","Data":"81267af9e82f0dc6fe7a51329b4f4c8d719c6cc88ca7e302225cb30d1062a000"}
Jul 26 15:10:19.199146 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:19.199091    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-kjx9x" podStartSLOduration=1.895818968 podStartE2EDuration="6.199070778s" totalImagesPullingTime="4.30325181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:19.198252815 +0000 UTC m=+308.571302608" watchObservedRunningTime="2026-07-26 15:10:19.199070778 +0000 UTC m=+308.572120560"
Jul 26 15:10:20.702910 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.699059    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pjffn"]
Jul 26 15:10:20.702910 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.702623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.705313 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.705211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 26 15:10:20.705487 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.705470    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gn4ps\""
Jul 26 15:10:20.705562 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.705483    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 26 15:10:20.707064 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.707044    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-root\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da28c14f-8e36-4f09-bd89-7b990215a019-metrics-client-ca\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-tls\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-textfile\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-wtmp\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-sys\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.753709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.753569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrgb5\" (UniqueName: \"kubernetes.io/projected/da28c14f-8e36-4f09-bd89-7b990215a019-kube-api-access-jrgb5\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-wtmp\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-sys\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrgb5\" (UniqueName: \"kubernetes.io/projected/da28c14f-8e36-4f09-bd89-7b990215a019-kube-api-access-jrgb5\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-root\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da28c14f-8e36-4f09-bd89-7b990215a019-metrics-client-ca\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-tls\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-textfile\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-wtmp\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.854750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.854671    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-root\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.855494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.855051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-textfile\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.855494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.855097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da28c14f-8e36-4f09-bd89-7b990215a019-sys\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.855494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.855094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.855494 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:10:20.855407    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 26 15:10:20.855494 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:10:20.855469    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-tls podName:da28c14f-8e36-4f09-bd89-7b990215a019 nodeName:}" failed. No retries permitted until 2026-07-26 15:10:21.355450162 +0000 UTC m=+310.728499922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-tls") pod "node-exporter-pjffn" (UID: "da28c14f-8e36-4f09-bd89-7b990215a019") : secret "node-exporter-tls" not found
Jul 26 15:10:20.855756 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.855526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da28c14f-8e36-4f09-bd89-7b990215a019-metrics-client-ca\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.858638 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.858613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:20.865940 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:20.865880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrgb5\" (UniqueName: \"kubernetes.io/projected/da28c14f-8e36-4f09-bd89-7b990215a019-kube-api-access-jrgb5\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:21.190063 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:21.190020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f849c67cb-2r6x5" event={"ID":"a463c219-6b44-4b6a-a714-42ec58a3701a","Type":"ContainerStarted","Data":"4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b"}
Jul 26 15:10:21.213561 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:21.213497    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f849c67cb-2r6x5" podStartSLOduration=1.7478105739999998 podStartE2EDuration="6.213476408s" totalImagesPullingTime="4.465665834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:21.212876976 +0000 UTC m=+310.585926751" watchObservedRunningTime="2026-07-26 15:10:21.213476408 +0000 UTC m=+310.586526188"
Jul 26 15:10:21.362769 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:21.362731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-tls\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:21.365421 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:21.365393    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da28c14f-8e36-4f09-bd89-7b990215a019-node-exporter-tls\") pod \"node-exporter-pjffn\" (UID: \"da28c14f-8e36-4f09-bd89-7b990215a019\") " pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:21.618301 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:21.618264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pjffn"
Jul 26 15:10:22.660905 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.660842    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-766575d4cd-g8sj4"]
Jul 26 15:10:22.683648 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.683615    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-766575d4cd-g8sj4"]
Jul 26 15:10:22.683812 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.683749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.686989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.686966    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 26 15:10:22.687145 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.686991    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-99iotasrpej4n\""
Jul 26 15:10:22.687145 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.686965    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 26 15:10:22.687320 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.687294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 26 15:10:22.687414 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.687326    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 26 15:10:22.687637 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.687616    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 26 15:10:22.687729 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.687620    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9b2jq\""
Jul 26 15:10:22.776677 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.776644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.776677 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.776682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-grpc-tls\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.776880 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.776719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4a2c539-8c00-400b-9d90-07edf2ecf116-metrics-client-ca\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.776880 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.776825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.776962 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.776902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d69m\" (UniqueName: \"kubernetes.io/projected/e4a2c539-8c00-400b-9d90-07edf2ecf116-kube-api-access-2d69m\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.776996 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.776957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.777032 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.776994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.777032 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.777023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-tls\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.878091 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.878056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d69m\" (UniqueName: \"kubernetes.io/projected/e4a2c539-8c00-400b-9d90-07edf2ecf116-kube-api-access-2d69m\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.878242 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.878107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.878242 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.878197    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.878325 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.878241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-tls\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.878325 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.878281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.878325 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.878318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-grpc-tls\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.879212 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.878534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4a2c539-8c00-400b-9d90-07edf2ecf116-metrics-client-ca\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.879212 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.878601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.879473 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.879304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4a2c539-8c00-400b-9d90-07edf2ecf116-metrics-client-ca\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.881006 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.880982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-tls\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.881109 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.881038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.881325 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.881302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.881402 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.881325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.881402 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.881325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.881690 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.881671    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4a2c539-8c00-400b-9d90-07edf2ecf116-secret-grpc-tls\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.891484 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.891462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d69m\" (UniqueName: \"kubernetes.io/projected/e4a2c539-8c00-400b-9d90-07edf2ecf116-kube-api-access-2d69m\") pod \"thanos-querier-766575d4cd-g8sj4\" (UID: \"e4a2c539-8c00-400b-9d90-07edf2ecf116\") " pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:22.996450 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:22.996355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:23.510217 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:23.510123    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda28c14f_8e36_4f09_bd89_7b990215a019.slice/crio-e4f47d5b0f375673e2592c7333c155544aa2dbe7fd79c3923959bdc0026d6378 WatchSource:0}: Error finding container e4f47d5b0f375673e2592c7333c155544aa2dbe7fd79c3923959bdc0026d6378: Status 404 returned error can't find the container with id e4f47d5b0f375673e2592c7333c155544aa2dbe7fd79c3923959bdc0026d6378
Jul 26 15:10:23.657137 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:23.657109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-766575d4cd-g8sj4"]
Jul 26 15:10:23.657791 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:23.657772    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a2c539_8c00_400b_9d90_07edf2ecf116.slice/crio-32bfb1cfbcbb5ec9cf5d6559934709e53e281c60ff4c5eb22558e3bdae20cfe7 WatchSource:0}: Error finding container 32bfb1cfbcbb5ec9cf5d6559934709e53e281c60ff4c5eb22558e3bdae20cfe7: Status 404 returned error can't find the container with id 32bfb1cfbcbb5ec9cf5d6559934709e53e281c60ff4c5eb22558e3bdae20cfe7
Jul 26 15:10:24.205746 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:24.205656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mljx" event={"ID":"d97c7d59-c3b6-4690-812c-f80b3368df12","Type":"ContainerStarted","Data":"4c5b76a0e7279dd4f1537f0093dfb1fd937d96ecea1a0946e35876555baf0adf"}
Jul 26 15:10:24.207642 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:24.207599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjffn" event={"ID":"da28c14f-8e36-4f09-bd89-7b990215a019","Type":"ContainerStarted","Data":"e4f47d5b0f375673e2592c7333c155544aa2dbe7fd79c3923959bdc0026d6378"}
Jul 26 15:10:24.209709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:24.209680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4" event={"ID":"e4a2c539-8c00-400b-9d90-07edf2ecf116","Type":"ContainerStarted","Data":"32bfb1cfbcbb5ec9cf5d6559934709e53e281c60ff4c5eb22558e3bdae20cfe7"}
Jul 26 15:10:25.098330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.095475    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c7f94c47d-bgzz6"]
Jul 26 15:10:25.099738 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.099685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.107146 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.107124    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 26 15:10:25.108992 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.108797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2gsr562dfivgd\""
Jul 26 15:10:25.108992 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.108824    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 26 15:10:25.108992 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.108828    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 26 15:10:25.108992 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.108934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9zqg7\""
Jul 26 15:10:25.109238 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.109013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 26 15:10:25.122192 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.122162    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c7f94c47d-bgzz6"]
Jul 26 15:10:25.203802 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.203765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3061f31-44e2-4204-9db7-0489d9016057-metrics-server-audit-profiles\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.204006 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.203812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-client-ca-bundle\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.204006 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.203905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3061f31-44e2-4204-9db7-0489d9016057-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.204006 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.203940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-secret-metrics-server-tls\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.204006 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.203957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3061f31-44e2-4204-9db7-0489d9016057-audit-log\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.204006 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.203991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfcwj\" (UniqueName: \"kubernetes.io/projected/b3061f31-44e2-4204-9db7-0489d9016057-kube-api-access-gfcwj\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.204269 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.204226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-secret-metrics-server-client-certs\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.216810 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.216775    2580 generic.go:356] "Generic (PLEG): container finished" podID="da28c14f-8e36-4f09-bd89-7b990215a019" containerID="429d0999bdff3017ec1ee1d85ca5383ee0883c8b5cf4389337259b2e44360e04" exitCode=0
Jul 26 15:10:25.217316 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.216839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjffn" event={"ID":"da28c14f-8e36-4f09-bd89-7b990215a019","Type":"ContainerDied","Data":"429d0999bdff3017ec1ee1d85ca5383ee0883c8b5cf4389337259b2e44360e04"}
Jul 26 15:10:25.305457 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.305417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-secret-metrics-server-tls\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.305457 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.305462    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3061f31-44e2-4204-9db7-0489d9016057-audit-log\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.305716 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.305490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfcwj\" (UniqueName: \"kubernetes.io/projected/b3061f31-44e2-4204-9db7-0489d9016057-kube-api-access-gfcwj\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.305930 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.305868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3061f31-44e2-4204-9db7-0489d9016057-audit-log\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.306056 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.305994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-secret-metrics-server-client-certs\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.306125 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.306109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3061f31-44e2-4204-9db7-0489d9016057-metrics-server-audit-profiles\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.306189 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.306143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-client-ca-bundle\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.306245 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.306190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3061f31-44e2-4204-9db7-0489d9016057-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.306877 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.306850    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3061f31-44e2-4204-9db7-0489d9016057-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.307161 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.307136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3061f31-44e2-4204-9db7-0489d9016057-metrics-server-audit-profiles\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.308847 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.308824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-secret-metrics-server-client-certs\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.308975 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.308904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-secret-metrics-server-tls\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.308975 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.308948    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3061f31-44e2-4204-9db7-0489d9016057-client-ca-bundle\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.314601 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.314581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfcwj\" (UniqueName: \"kubernetes.io/projected/b3061f31-44e2-4204-9db7-0489d9016057-kube-api-access-gfcwj\") pod \"metrics-server-c7f94c47d-bgzz6\" (UID: \"b3061f31-44e2-4204-9db7-0489d9016057\") " pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.379610 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.379500    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:25.379610 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.379579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:25.385797 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.385765    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:25.411109 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.411045    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:25.476436 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.476398    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"]
Jul 26 15:10:25.480163 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.480034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:25.482799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.482770    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gq699\""
Jul 26 15:10:25.482953 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.482806    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 26 15:10:25.487754 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.487698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"]
Jul 26 15:10:25.600875 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.600831    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8564f8bd84-4dv75"]
Jul 26 15:10:25.609125 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.608928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69ef4931-7bff-40f4-a487-cdea47583b31-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-d6875\" (UID: \"69ef4931-7bff-40f4-a487-cdea47583b31\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:25.609125 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.609036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcr7f\" (UniqueName: \"kubernetes.io/projected/69ef4931-7bff-40f4-a487-cdea47583b31-kube-api-access-fcr7f\") pod \"monitoring-plugin-68b7fc9574-d6875\" (UID: \"69ef4931-7bff-40f4-a487-cdea47583b31\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:25.710020 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.709938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcr7f\" (UniqueName: \"kubernetes.io/projected/69ef4931-7bff-40f4-a487-cdea47583b31-kube-api-access-fcr7f\") pod \"monitoring-plugin-68b7fc9574-d6875\" (UID: \"69ef4931-7bff-40f4-a487-cdea47583b31\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:25.710159 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.710056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69ef4931-7bff-40f4-a487-cdea47583b31-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-d6875\" (UID: \"69ef4931-7bff-40f4-a487-cdea47583b31\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:25.710207 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:10:25.710177    2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 26 15:10:25.710241 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:10:25.710235    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ef4931-7bff-40f4-a487-cdea47583b31-monitoring-plugin-cert podName:69ef4931-7bff-40f4-a487-cdea47583b31 nodeName:}" failed. No retries permitted until 2026-07-26 15:10:26.210220465 +0000 UTC m=+315.583270221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/69ef4931-7bff-40f4-a487-cdea47583b31-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-d6875" (UID: "69ef4931-7bff-40f4-a487-cdea47583b31") : secret "monitoring-plugin-cert" not found
Jul 26 15:10:25.719858 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.719814    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcr7f\" (UniqueName: \"kubernetes.io/projected/69ef4931-7bff-40f4-a487-cdea47583b31-kube-api-access-fcr7f\") pod \"monitoring-plugin-68b7fc9574-d6875\" (UID: \"69ef4931-7bff-40f4-a487-cdea47583b31\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:25.877231 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.877199    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"]
Jul 26 15:10:25.882604 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.882578    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:25.885362 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.885312    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 26 15:10:25.885362 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.885338    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 26 15:10:25.885554 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.885372    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 26 15:10:25.885738 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.885657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 26 15:10:25.885738 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.885710    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 26 15:10:25.885738 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.885659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j6gxn\""
Jul 26 15:10:25.892262 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.892213    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 26 15:10:25.894324 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:25.894303    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"]
Jul 26 15:10:26.013026 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.012930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-federate-client-tls\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.013026 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.013000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.013229 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.013027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.013229 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.013100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w7ns\" (UniqueName: \"kubernetes.io/projected/abad83fa-9507-433e-a41c-fa1cb592e391-kube-api-access-4w7ns\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.013229 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.013154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-telemeter-client-tls\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.013229 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.013195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-serving-certs-ca-bundle\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.013387 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.013230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-metrics-client-ca\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.013387 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.013297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-secret-telemeter-client\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.113750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.113705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w7ns\" (UniqueName: \"kubernetes.io/projected/abad83fa-9507-433e-a41c-fa1cb592e391-kube-api-access-4w7ns\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.113948 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.113772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-telemeter-client-tls\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.113948 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.113816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-serving-certs-ca-bundle\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.113948 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.113863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-metrics-client-ca\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.113948 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.113931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-secret-telemeter-client\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.114160 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.113965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-federate-client-tls\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.114160 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.114005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.114160 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.114027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.114677 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.114607    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-serving-certs-ca-bundle\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.115081 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.115057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-metrics-client-ca\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.115188 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.115151    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abad83fa-9507-433e-a41c-fa1cb592e391-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.116672 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.116646    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.116976 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.116955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-telemeter-client-tls\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.117058 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.116955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-secret-telemeter-client\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.117113 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.117051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/abad83fa-9507-433e-a41c-fa1cb592e391-federate-client-tls\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.125028 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.124984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w7ns\" (UniqueName: \"kubernetes.io/projected/abad83fa-9507-433e-a41c-fa1cb592e391-kube-api-access-4w7ns\") pod \"telemeter-client-5d56c64d44-lvxc7\" (UID: \"abad83fa-9507-433e-a41c-fa1cb592e391\") " pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.195997 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.195954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"
Jul 26 15:10:26.214793 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.214764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69ef4931-7bff-40f4-a487-cdea47583b31-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-d6875\" (UID: \"69ef4931-7bff-40f4-a487-cdea47583b31\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:26.217418 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.217394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69ef4931-7bff-40f4-a487-cdea47583b31-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-d6875\" (UID: \"69ef4931-7bff-40f4-a487-cdea47583b31\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:26.224334 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.224308    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:10:26.394720 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:26.394677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:27.802866 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:27.802813    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"]
Jul 26 15:10:27.808243 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:27.808209    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ef4931_7bff_40f4_a487_cdea47583b31.slice/crio-123e462c0be2243c745ad7869f3b0d8c9b1dac74d7422cdc1770a7ee22b48b0c WatchSource:0}: Error finding container 123e462c0be2243c745ad7869f3b0d8c9b1dac74d7422cdc1770a7ee22b48b0c: Status 404 returned error can't find the container with id 123e462c0be2243c745ad7869f3b0d8c9b1dac74d7422cdc1770a7ee22b48b0c
Jul 26 15:10:28.033141 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.033090    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c7f94c47d-bgzz6"]
Jul 26 15:10:28.035492 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:28.035459    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3061f31_44e2_4204_9db7_0489d9016057.slice/crio-5bddb9e4f9079f8dca703d7436254eb747d5606277937f943680219de0f69246 WatchSource:0}: Error finding container 5bddb9e4f9079f8dca703d7436254eb747d5606277937f943680219de0f69246: Status 404 returned error can't find the container with id 5bddb9e4f9079f8dca703d7436254eb747d5606277937f943680219de0f69246
Jul 26 15:10:28.039229 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.039206    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d56c64d44-lvxc7"]
Jul 26 15:10:28.041432 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:10:28.041409    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabad83fa_9507_433e_a41c_fa1cb592e391.slice/crio-9d7ac72ac0068b95172cf68abc08c266a4eb00785fd0835e4d3447d80c58e2af WatchSource:0}: Error finding container 9d7ac72ac0068b95172cf68abc08c266a4eb00785fd0835e4d3447d80c58e2af: Status 404 returned error can't find the container with id 9d7ac72ac0068b95172cf68abc08c266a4eb00785fd0835e4d3447d80c58e2af
Jul 26 15:10:28.231793 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.231700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjffn" event={"ID":"da28c14f-8e36-4f09-bd89-7b990215a019","Type":"ContainerStarted","Data":"499df5eb61a15016218e95a1aecba5f7c1fcc62d71ff2e9c672e98ea8bb34963"}
Jul 26 15:10:28.231793 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.231767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjffn" event={"ID":"da28c14f-8e36-4f09-bd89-7b990215a019","Type":"ContainerStarted","Data":"c3eeae5ab68ae784b577b4c0ef70f50f50e2260683a6bd2f54016412bd385127"}
Jul 26 15:10:28.233533 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.233505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mljx" event={"ID":"d97c7d59-c3b6-4690-812c-f80b3368df12","Type":"ContainerStarted","Data":"fab496225ea0747c60cf44300102296a45a94e85de5627d7eae8ff3ed5c69d2c"}
Jul 26 15:10:28.235344 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.235310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4" event={"ID":"e4a2c539-8c00-400b-9d90-07edf2ecf116","Type":"ContainerStarted","Data":"6ba0f943dbb19c5556e98e5191b07410e743f633346e5ca6b396eb55c9964bc6"}
Jul 26 15:10:28.235442 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.235386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4" event={"ID":"e4a2c539-8c00-400b-9d90-07edf2ecf116","Type":"ContainerStarted","Data":"81f6968280ba2ca46c69cb4eb09a231f6c092c8059b9b3359880bfcd531b315f"}
Jul 26 15:10:28.235442 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.235428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4" event={"ID":"e4a2c539-8c00-400b-9d90-07edf2ecf116","Type":"ContainerStarted","Data":"98d96f59aa7ee2ba60cd333fee96d8369d8bf754d24dd466cde5d1164d1aff78"}
Jul 26 15:10:28.236438 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.236383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6" event={"ID":"b3061f31-44e2-4204-9db7-0489d9016057","Type":"ContainerStarted","Data":"5bddb9e4f9079f8dca703d7436254eb747d5606277937f943680219de0f69246"}
Jul 26 15:10:28.237448 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.237417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7" event={"ID":"abad83fa-9507-433e-a41c-fa1cb592e391","Type":"ContainerStarted","Data":"9d7ac72ac0068b95172cf68abc08c266a4eb00785fd0835e4d3447d80c58e2af"}
Jul 26 15:10:28.238679 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.238661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875" event={"ID":"69ef4931-7bff-40f4-a487-cdea47583b31","Type":"ContainerStarted","Data":"123e462c0be2243c745ad7869f3b0d8c9b1dac74d7422cdc1770a7ee22b48b0c"}
Jul 26 15:10:28.256024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.255981    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pjffn" podStartSLOduration=7.274078779 podStartE2EDuration="8.255967386s" totalImagesPullingTime="901.329053ms" totalInitContainerRuntime="80.559554ms" isStatefulPod=true podCreationTimestamp="2026-07-26 15:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:28.25495228 +0000 UTC m=+317.628002059" watchObservedRunningTime="2026-07-26 15:10:28.255967386 +0000 UTC m=+317.629017165"
Jul 26 15:10:28.272495 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:28.272456    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7mljx" podStartSLOduration=33.10136177 podStartE2EDuration="47.272444383s" totalImagesPullingTime="14.171082613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:09:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:28.272006906 +0000 UTC m=+317.645056684" watchObservedRunningTime="2026-07-26 15:10:28.272444383 +0000 UTC m=+317.645494162"
Jul 26 15:10:29.249708 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:29.249667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4" event={"ID":"e4a2c539-8c00-400b-9d90-07edf2ecf116","Type":"ContainerStarted","Data":"a2d2e64d9a3b52263bb8febed6f452281657983dc8a8b196ade6a5b1668e668b"}
Jul 26 15:10:29.250196 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:29.249739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4" event={"ID":"e4a2c539-8c00-400b-9d90-07edf2ecf116","Type":"ContainerStarted","Data":"2bb70c518b2d298d869b9a83b748a3825939ea933c29e9593f68f0f20ab6a866"}
Jul 26 15:10:29.250196 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:29.249782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4" event={"ID":"e4a2c539-8c00-400b-9d90-07edf2ecf116","Type":"ContainerStarted","Data":"d8830a3fd8db5ca7038044f899e6edbdf1e5e44ea79b6d3d96336a019529d0b7"}
Jul 26 15:10:29.280676 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:29.280617    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4" podStartSLOduration=2.378449144 podStartE2EDuration="7.280601668s" totalImagesPullingTime="4.902152524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:10:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:29.27793962 +0000 UTC m=+318.650989399" watchObservedRunningTime="2026-07-26 15:10:29.280601668 +0000 UTC m=+318.653651473"
Jul 26 15:10:30.254284 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:30.254248    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:31.260430 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:31.260394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875" event={"ID":"69ef4931-7bff-40f4-a487-cdea47583b31","Type":"ContainerStarted","Data":"4ef306f692573bdc3044ab30a2175d9a028512f87059bd36947e2696dd5e5dc3"}
Jul 26 15:10:31.261029 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:31.260691    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:31.262559 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:31.262528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6" event={"ID":"b3061f31-44e2-4204-9db7-0489d9016057","Type":"ContainerStarted","Data":"c95485be1c34ac136cecf6dacf4f69732870dbe55d2a77940bb109714d746e89"}
Jul 26 15:10:31.264356 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:31.264327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7" event={"ID":"abad83fa-9507-433e-a41c-fa1cb592e391","Type":"ContainerStarted","Data":"75dc1b401f676d9f271d9805e0fccaf2eee9024f1d61394f46aaf0328fc3d45c"}
Jul 26 15:10:31.266513 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:31.266490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875"
Jul 26 15:10:31.282873 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:31.282782    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-d6875" podStartSLOduration=3.6229453400000002 podStartE2EDuration="6.282763375s" totalImagesPullingTime="2.659818035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:31.282577491 +0000 UTC m=+320.655627272" watchObservedRunningTime="2026-07-26 15:10:31.282763375 +0000 UTC m=+320.655813155"
Jul 26 15:10:31.301222 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:31.301162    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6" podStartSLOduration=3.8633387089999998 podStartE2EDuration="6.301141029s" totalImagesPullingTime="2.43780232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:31.298996417 +0000 UTC m=+320.672046197" watchObservedRunningTime="2026-07-26 15:10:31.301141029 +0000 UTC m=+320.674190809"
Jul 26 15:10:32.270349 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:32.270307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7" event={"ID":"abad83fa-9507-433e-a41c-fa1cb592e391","Type":"ContainerStarted","Data":"fca26761d512076c80273ffae3460a9e417c4e55695a90ee36b98323a677cdcd"}
Jul 26 15:10:32.270709 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:32.270399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7" event={"ID":"abad83fa-9507-433e-a41c-fa1cb592e391","Type":"ContainerStarted","Data":"0a7255deb918e8f538df62b9c26e369e4d32187d68a0ffa5dcad0a19b2b23dc3"}
Jul 26 15:10:32.296454 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:32.296405    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d56c64d44-lvxc7" podStartSLOduration=3.92476258 podStartE2EDuration="7.296390746s" totalImagesPullingTime="3.371628166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:10:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:10:32.295474105 +0000 UTC m=+321.668523906" watchObservedRunningTime="2026-07-26 15:10:32.296390746 +0000 UTC m=+321.669440574"
Jul 26 15:10:36.270789 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:36.270761    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-766575d4cd-g8sj4"
Jul 26 15:10:44.143065 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:44.143030    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f849c67cb-2r6x5"]
Jul 26 15:10:45.411575 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:45.411528    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:45.412101 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:45.411608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:10:50.627842 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:50.627770    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" podUID="56875603-c25a-4d16-a4c4-7ed403a427ad" containerName="registry" containerID="cri-o://ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f" gracePeriod=30
Jul 26 15:10:50.951854 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:50.951825    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:10:51.039966 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.039928    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-certificates\") pod \"56875603-c25a-4d16-a4c4-7ed403a427ad\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") "
Jul 26 15:10:51.039966 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.039965    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-bound-sa-token\") pod \"56875603-c25a-4d16-a4c4-7ed403a427ad\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") "
Jul 26 15:10:51.040209 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.039993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-installation-pull-secrets\") pod \"56875603-c25a-4d16-a4c4-7ed403a427ad\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") "
Jul 26 15:10:51.040209 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.040013    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-image-registry-private-configuration\") pod \"56875603-c25a-4d16-a4c4-7ed403a427ad\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") "
Jul 26 15:10:51.040209 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.040080    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56875603-c25a-4d16-a4c4-7ed403a427ad-ca-trust-extracted\") pod \"56875603-c25a-4d16-a4c4-7ed403a427ad\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") "
Jul 26 15:10:51.040209 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.040109    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") pod \"56875603-c25a-4d16-a4c4-7ed403a427ad\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") "
Jul 26 15:10:51.040209 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.040153    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr9wr\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-kube-api-access-mr9wr\") pod \"56875603-c25a-4d16-a4c4-7ed403a427ad\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") "
Jul 26 15:10:51.040209 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.040195    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-trusted-ca\") pod \"56875603-c25a-4d16-a4c4-7ed403a427ad\" (UID: \"56875603-c25a-4d16-a4c4-7ed403a427ad\") "
Jul 26 15:10:51.040471 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.040444    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "56875603-c25a-4d16-a4c4-7ed403a427ad" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:10:51.040561 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.040542    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-certificates\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:10:51.040842 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.040802    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "56875603-c25a-4d16-a4c4-7ed403a427ad" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:10:51.042678 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.042652    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "56875603-c25a-4d16-a4c4-7ed403a427ad" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:10:51.042799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.042706    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "56875603-c25a-4d16-a4c4-7ed403a427ad" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:10:51.042943 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.042917    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-kube-api-access-mr9wr" (OuterVolumeSpecName: "kube-api-access-mr9wr") pod "56875603-c25a-4d16-a4c4-7ed403a427ad" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad"). InnerVolumeSpecName "kube-api-access-mr9wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:10:51.042943 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.042918    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "56875603-c25a-4d16-a4c4-7ed403a427ad" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:10:51.043027 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.042923    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "56875603-c25a-4d16-a4c4-7ed403a427ad" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:10:51.050737 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.050710    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56875603-c25a-4d16-a4c4-7ed403a427ad-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "56875603-c25a-4d16-a4c4-7ed403a427ad" (UID: "56875603-c25a-4d16-a4c4-7ed403a427ad"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:10:51.141572 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.141532    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-bound-sa-token\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:10:51.141572 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.141564    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-installation-pull-secrets\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:10:51.141572 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.141575    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56875603-c25a-4d16-a4c4-7ed403a427ad-image-registry-private-configuration\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:10:51.141797 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.141585    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56875603-c25a-4d16-a4c4-7ed403a427ad-ca-trust-extracted\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:10:51.141797 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.141594    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-registry-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:10:51.141797 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.141602    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr9wr\" (UniqueName: \"kubernetes.io/projected/56875603-c25a-4d16-a4c4-7ed403a427ad-kube-api-access-mr9wr\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:10:51.141797 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.141610    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56875603-c25a-4d16-a4c4-7ed403a427ad-trusted-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:10:51.343126 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.343089    2580 generic.go:356] "Generic (PLEG): container finished" podID="56875603-c25a-4d16-a4c4-7ed403a427ad" containerID="ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f" exitCode=0
Jul 26 15:10:51.343294 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.343142    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75"
Jul 26 15:10:51.343294 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.343163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" event={"ID":"56875603-c25a-4d16-a4c4-7ed403a427ad","Type":"ContainerDied","Data":"ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f"}
Jul 26 15:10:51.343294 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.343198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8564f8bd84-4dv75" event={"ID":"56875603-c25a-4d16-a4c4-7ed403a427ad","Type":"ContainerDied","Data":"fa572c66ad261792506c6d4b35f1bc260f0bc7a81cf21ab90c311235c3e92085"}
Jul 26 15:10:51.343294 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.343226    2580 scope.go:117] "RemoveContainer" containerID="ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f"
Jul 26 15:10:51.359860 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.359839    2580 scope.go:117] "RemoveContainer" containerID="ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f"
Jul 26 15:10:51.360180 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:10:51.360156    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f\": container with ID starting with ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f not found: ID does not exist" containerID="ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f"
Jul 26 15:10:51.360262 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.360190    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f"} err="failed to get container status \"ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f\": rpc error: code = NotFound desc = could not find container \"ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f\": container with ID starting with ba26d46c22acd37240c6aa3231b2b88c3cc7f0830f0e183fe4c4512073d9c30f not found: ID does not exist"
Jul 26 15:10:51.360450 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.360431    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8564f8bd84-4dv75"]
Jul 26 15:10:51.363781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:51.363759    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8564f8bd84-4dv75"]
Jul 26 15:10:53.160038 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:10:53.159999    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56875603-c25a-4d16-a4c4-7ed403a427ad" path="/var/lib/kubelet/pods/56875603-c25a-4d16-a4c4-7ed403a427ad/volumes"
Jul 26 15:11:05.416856 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:05.416780    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:11:05.420670 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:05.420642    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c7f94c47d-bgzz6"
Jul 26 15:11:09.162278 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.162223    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f849c67cb-2r6x5" podUID="a463c219-6b44-4b6a-a714-42ec58a3701a" containerName="console" containerID="cri-o://4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b" gracePeriod=15
Jul 26 15:11:09.408764 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.408738    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:11:09.409771 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.409749    2580 generic.go:356] "Generic (PLEG): container finished" podID="a463c219-6b44-4b6a-a714-42ec58a3701a" containerID="4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b" exitCode=0
Jul 26 15:11:09.409922 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.409825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f849c67cb-2r6x5" event={"ID":"a463c219-6b44-4b6a-a714-42ec58a3701a","Type":"ContainerDied","Data":"4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b"}
Jul 26 15:11:09.409922 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.409907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f849c67cb-2r6x5" event={"ID":"a463c219-6b44-4b6a-a714-42ec58a3701a","Type":"ContainerDied","Data":"57cc4e8d5c85ae1e8e81478eca1ab52e9515189929446fb240d97719c534acde"}
Jul 26 15:11:09.409922 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.409918    2580 scope.go:117] "RemoveContainer" containerID="4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b"
Jul 26 15:11:09.417804 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.417783    2580 scope.go:117] "RemoveContainer" containerID="4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b"
Jul 26 15:11:09.418078 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:11:09.418059    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b\": container with ID starting with 4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b not found: ID does not exist" containerID="4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b"
Jul 26 15:11:09.418131 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.418088    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b"} err="failed to get container status \"4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b\": rpc error: code = NotFound desc = could not find container \"4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b\": container with ID starting with 4eebaf20bc759a31c1dd79a51750a5bab85da5e3f14359dd7e636a8dab10e15b not found: ID does not exist"
Jul 26 15:11:09.488261 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488229    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-trusted-ca-bundle\") pod \"a463c219-6b44-4b6a-a714-42ec58a3701a\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") "
Jul 26 15:11:09.488261 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488261    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x446h\" (UniqueName: \"kubernetes.io/projected/a463c219-6b44-4b6a-a714-42ec58a3701a-kube-api-access-x446h\") pod \"a463c219-6b44-4b6a-a714-42ec58a3701a\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") "
Jul 26 15:11:09.488494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488306    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-console-config\") pod \"a463c219-6b44-4b6a-a714-42ec58a3701a\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") "
Jul 26 15:11:09.488494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488342    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-serving-cert\") pod \"a463c219-6b44-4b6a-a714-42ec58a3701a\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") "
Jul 26 15:11:09.488494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488380    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-oauth-config\") pod \"a463c219-6b44-4b6a-a714-42ec58a3701a\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") "
Jul 26 15:11:09.488494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488399    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-service-ca\") pod \"a463c219-6b44-4b6a-a714-42ec58a3701a\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") "
Jul 26 15:11:09.488494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488431    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-oauth-serving-cert\") pod \"a463c219-6b44-4b6a-a714-42ec58a3701a\" (UID: \"a463c219-6b44-4b6a-a714-42ec58a3701a\") "
Jul 26 15:11:09.488751 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488608    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a463c219-6b44-4b6a-a714-42ec58a3701a" (UID: "a463c219-6b44-4b6a-a714-42ec58a3701a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:11:09.488821 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488722    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-console-config" (OuterVolumeSpecName: "console-config") pod "a463c219-6b44-4b6a-a714-42ec58a3701a" (UID: "a463c219-6b44-4b6a-a714-42ec58a3701a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:11:09.488967 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.488881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-service-ca" (OuterVolumeSpecName: "service-ca") pod "a463c219-6b44-4b6a-a714-42ec58a3701a" (UID: "a463c219-6b44-4b6a-a714-42ec58a3701a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:11:09.489063 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.489046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a463c219-6b44-4b6a-a714-42ec58a3701a" (UID: "a463c219-6b44-4b6a-a714-42ec58a3701a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:11:09.490495 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.490475    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a463c219-6b44-4b6a-a714-42ec58a3701a-kube-api-access-x446h" (OuterVolumeSpecName: "kube-api-access-x446h") pod "a463c219-6b44-4b6a-a714-42ec58a3701a" (UID: "a463c219-6b44-4b6a-a714-42ec58a3701a"). InnerVolumeSpecName "kube-api-access-x446h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:11:09.490875 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.490839    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a463c219-6b44-4b6a-a714-42ec58a3701a" (UID: "a463c219-6b44-4b6a-a714-42ec58a3701a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:11:09.490875 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.490848    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a463c219-6b44-4b6a-a714-42ec58a3701a" (UID: "a463c219-6b44-4b6a-a714-42ec58a3701a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:11:09.589369 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.589336    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-oauth-config\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:11:09.589369 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.589365    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:11:09.589369 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.589374    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-oauth-serving-cert\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:11:09.589572 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.589382    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-trusted-ca-bundle\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:11:09.589572 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.589391    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x446h\" (UniqueName: \"kubernetes.io/projected/a463c219-6b44-4b6a-a714-42ec58a3701a-kube-api-access-x446h\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:11:09.589572 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.589403    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a463c219-6b44-4b6a-a714-42ec58a3701a-console-config\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:11:09.589572 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:09.589411    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a463c219-6b44-4b6a-a714-42ec58a3701a-console-serving-cert\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:11:10.413938 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:10.413906    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f849c67cb-2r6x5"
Jul 26 15:11:10.433592 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:10.433567    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f849c67cb-2r6x5"]
Jul 26 15:11:10.437111 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:10.437089    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f849c67cb-2r6x5"]
Jul 26 15:11:11.158712 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:11.158673    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a463c219-6b44-4b6a-a714-42ec58a3701a" path="/var/lib/kubelet/pods/a463c219-6b44-4b6a-a714-42ec58a3701a/volumes"
Jul 26 15:11:25.121962 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:25.121922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:11:25.124224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:25.124193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f03e5fc-b967-47e5-a60e-22a7a78204c6-metrics-certs\") pod \"network-metrics-daemon-qb9cd\" (UID: \"3f03e5fc-b967-47e5-a60e-22a7a78204c6\") " pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:11:25.158293 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:25.158264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tgnb2\""
Jul 26 15:11:25.165400 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:25.165380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qb9cd"
Jul 26 15:11:25.290304 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:25.290280    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qb9cd"]
Jul 26 15:11:25.292334 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:11:25.292307    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f03e5fc_b967_47e5_a60e_22a7a78204c6.slice/crio-e18ddabf0368922386c16654dbe2a6ca104c0de49c59bff8145d7ed5cbabd720 WatchSource:0}: Error finding container e18ddabf0368922386c16654dbe2a6ca104c0de49c59bff8145d7ed5cbabd720: Status 404 returned error can't find the container with id e18ddabf0368922386c16654dbe2a6ca104c0de49c59bff8145d7ed5cbabd720
Jul 26 15:11:25.468801 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:25.468715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qb9cd" event={"ID":"3f03e5fc-b967-47e5-a60e-22a7a78204c6","Type":"ContainerStarted","Data":"e18ddabf0368922386c16654dbe2a6ca104c0de49c59bff8145d7ed5cbabd720"}
Jul 26 15:11:26.473783 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:26.473699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qb9cd" event={"ID":"3f03e5fc-b967-47e5-a60e-22a7a78204c6","Type":"ContainerStarted","Data":"1a0995880511cdffe618fcea969bde30e630496f8a4e909ab12ee32dc35173fb"}
Jul 26 15:11:26.473783 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:26.473758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qb9cd" event={"ID":"3f03e5fc-b967-47e5-a60e-22a7a78204c6","Type":"ContainerStarted","Data":"4f54f672218eab70a155c0426b6d58fc16b07b74c35a7c10f13572bf57ff79e7"}
Jul 26 15:11:26.490953 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:26.490902    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qb9cd" podStartSLOduration=374.5811082 podStartE2EDuration="6m15.49087302s" totalImagesPullingTime="909.76482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:11:26.488775637 +0000 UTC m=+375.861825417" watchObservedRunningTime="2026-07-26 15:11:26.49087302 +0000 UTC m=+375.863922798"
Jul 26 15:11:49.721116 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.721076    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659fbc9ff9-64j76"]
Jul 26 15:11:49.721578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.721395    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56875603-c25a-4d16-a4c4-7ed403a427ad" containerName="registry"
Jul 26 15:11:49.721578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.721408    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="56875603-c25a-4d16-a4c4-7ed403a427ad" containerName="registry"
Jul 26 15:11:49.721578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.721417    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a463c219-6b44-4b6a-a714-42ec58a3701a" containerName="console"
Jul 26 15:11:49.721578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.721422    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a463c219-6b44-4b6a-a714-42ec58a3701a" containerName="console"
Jul 26 15:11:49.721578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.721470    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a463c219-6b44-4b6a-a714-42ec58a3701a" containerName="console"
Jul 26 15:11:49.721578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.721478    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="56875603-c25a-4d16-a4c4-7ed403a427ad" containerName="registry"
Jul 26 15:11:49.724650 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.724624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.727799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.727773    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 26 15:11:49.727958 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.727937    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r8ctd\""
Jul 26 15:11:49.728090 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.728072    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 26 15:11:49.728176 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.728156    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 26 15:11:49.728282 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.728266    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 26 15:11:49.728397 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.728378    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 26 15:11:49.728588 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.728572    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 26 15:11:49.729207 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.729182    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 26 15:11:49.734686 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.734667    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 26 15:11:49.740158 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.740138    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659fbc9ff9-64j76"]
Jul 26 15:11:49.831031 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.830988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-config\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.831031 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.831036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-oauth-config\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.831269 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.831068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-trusted-ca-bundle\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.831269 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.831097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-serving-cert\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.831269 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.831121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-service-ca\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.831269 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.831158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-oauth-serving-cert\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.831269 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.831179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2kpt\" (UniqueName: \"kubernetes.io/projected/7894211b-ea2e-48ff-bfc8-9f60a1aace97-kube-api-access-t2kpt\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.931921 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.931869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-serving-cert\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932122 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.931931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-service-ca\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932122 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.931972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-oauth-serving-cert\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932122 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.931993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2kpt\" (UniqueName: \"kubernetes.io/projected/7894211b-ea2e-48ff-bfc8-9f60a1aace97-kube-api-access-t2kpt\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932122 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.932044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-config\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932122 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.932082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-oauth-config\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932122 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.932114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-trusted-ca-bundle\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932813 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.932789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-config\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932947 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.932925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-service-ca\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.932997 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.932950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-oauth-serving-cert\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.933126 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.933105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-trusted-ca-bundle\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.934512 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.934496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-serving-cert\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.934657 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.934639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-oauth-config\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:49.940984 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:49.940955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2kpt\" (UniqueName: \"kubernetes.io/projected/7894211b-ea2e-48ff-bfc8-9f60a1aace97-kube-api-access-t2kpt\") pod \"console-659fbc9ff9-64j76\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") " pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:50.034315 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:50.034277    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:11:50.165218 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:50.165191    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659fbc9ff9-64j76"]
Jul 26 15:11:50.167596 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:11:50.167571    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7894211b_ea2e_48ff_bfc8_9f60a1aace97.slice/crio-e232a0080cebf1e7ee161235ed54a9e61c7632dac865c57591a6ea040f1dc15c WatchSource:0}: Error finding container e232a0080cebf1e7ee161235ed54a9e61c7632dac865c57591a6ea040f1dc15c: Status 404 returned error can't find the container with id e232a0080cebf1e7ee161235ed54a9e61c7632dac865c57591a6ea040f1dc15c
Jul 26 15:11:50.565557 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:50.565524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fbc9ff9-64j76" event={"ID":"7894211b-ea2e-48ff-bfc8-9f60a1aace97","Type":"ContainerStarted","Data":"806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799"}
Jul 26 15:11:50.565725 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:50.565573    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fbc9ff9-64j76" event={"ID":"7894211b-ea2e-48ff-bfc8-9f60a1aace97","Type":"ContainerStarted","Data":"e232a0080cebf1e7ee161235ed54a9e61c7632dac865c57591a6ea040f1dc15c"}
Jul 26 15:11:50.587511 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:11:50.587461    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659fbc9ff9-64j76" podStartSLOduration=1.587444116 podStartE2EDuration="1.587444116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:11:50.58690696 +0000 UTC m=+399.959956733" watchObservedRunningTime="2026-07-26 15:11:50.587444116 +0000 UTC m=+399.960493895"
Jul 26 15:12:00.034671 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:00.034612    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:12:00.034671 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:00.034693    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:12:00.039475 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:00.039454    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:12:00.607668 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:00.607642    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:12:51.302314 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.302285    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"]
Jul 26 15:12:51.305526 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.305510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"
Jul 26 15:12:51.308529 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.308509    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 26 15:12:51.309308 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.309287    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-47j9r\""
Jul 26 15:12:51.309568 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.309549    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:12:51.320599 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.320578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"]
Jul 26 15:12:51.324652 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.324630    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv57d\" (UniqueName: \"kubernetes.io/projected/42aff341-07c6-41de-950e-2cba3d77c703-kube-api-access-zv57d\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhslx\" (UID: \"42aff341-07c6-41de-950e-2cba3d77c703\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"
Jul 26 15:12:51.324753 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.324659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42aff341-07c6-41de-950e-2cba3d77c703-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhslx\" (UID: \"42aff341-07c6-41de-950e-2cba3d77c703\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"
Jul 26 15:12:51.425093 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.425065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv57d\" (UniqueName: \"kubernetes.io/projected/42aff341-07c6-41de-950e-2cba3d77c703-kube-api-access-zv57d\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhslx\" (UID: \"42aff341-07c6-41de-950e-2cba3d77c703\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"
Jul 26 15:12:51.425236 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.425104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42aff341-07c6-41de-950e-2cba3d77c703-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhslx\" (UID: \"42aff341-07c6-41de-950e-2cba3d77c703\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"
Jul 26 15:12:51.425458 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.425443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42aff341-07c6-41de-950e-2cba3d77c703-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhslx\" (UID: \"42aff341-07c6-41de-950e-2cba3d77c703\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"
Jul 26 15:12:51.433479 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.433457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv57d\" (UniqueName: \"kubernetes.io/projected/42aff341-07c6-41de-950e-2cba3d77c703-kube-api-access-zv57d\") pod \"cert-manager-operator-controller-manager-55c444bf86-xhslx\" (UID: \"42aff341-07c6-41de-950e-2cba3d77c703\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"
Jul 26 15:12:51.614535 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.614459    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"
Jul 26 15:12:51.741699 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.741670    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx"]
Jul 26 15:12:51.744746 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:12:51.744721    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42aff341_07c6_41de_950e_2cba3d77c703.slice/crio-84fdaee08d86ac2e5207d7c7307dcefbeba7a5bd8620f7e80baabe8e1561c580 WatchSource:0}: Error finding container 84fdaee08d86ac2e5207d7c7307dcefbeba7a5bd8620f7e80baabe8e1561c580: Status 404 returned error can't find the container with id 84fdaee08d86ac2e5207d7c7307dcefbeba7a5bd8620f7e80baabe8e1561c580
Jul 26 15:12:51.794689 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:51.794659    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx" event={"ID":"42aff341-07c6-41de-950e-2cba3d77c703","Type":"ContainerStarted","Data":"84fdaee08d86ac2e5207d7c7307dcefbeba7a5bd8620f7e80baabe8e1561c580"}
Jul 26 15:12:54.810353 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:54.810317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx" event={"ID":"42aff341-07c6-41de-950e-2cba3d77c703","Type":"ContainerStarted","Data":"ba6ac288310c672d42b41608e1a55694247e863e2c9355cee6f73f4adf99b7f8"}
Jul 26 15:12:54.831166 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:12:54.831118    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xhslx" podStartSLOduration=0.965873734 podStartE2EDuration="3.83110467s" totalImagesPullingTime="2.865230936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:12:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:12:54.829391595 +0000 UTC m=+464.202441373" watchObservedRunningTime="2026-07-26 15:12:54.83110467 +0000 UTC m=+464.204154500"
Jul 26 15:13:00.630411 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.630368    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"]
Jul 26 15:13:00.633762 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.633741    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"
Jul 26 15:13:00.636739 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.636720    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 26 15:13:00.638079 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.638054    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 26 15:13:00.638188 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.638080    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l29dg\""
Jul 26 15:13:00.640434 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.640414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"]
Jul 26 15:13:00.700366 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.700332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8506cc19-270c-47f9-b804-8660fb804279-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vfbcc\" (UID: \"8506cc19-270c-47f9-b804-8660fb804279\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"
Jul 26 15:13:00.700366 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.700380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpsf4\" (UniqueName: \"kubernetes.io/projected/8506cc19-270c-47f9-b804-8660fb804279-kube-api-access-mpsf4\") pod \"cert-manager-cainjector-559cdd8c87-vfbcc\" (UID: \"8506cc19-270c-47f9-b804-8660fb804279\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"
Jul 26 15:13:00.801622 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.801595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8506cc19-270c-47f9-b804-8660fb804279-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vfbcc\" (UID: \"8506cc19-270c-47f9-b804-8660fb804279\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"
Jul 26 15:13:00.801721 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.801633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpsf4\" (UniqueName: \"kubernetes.io/projected/8506cc19-270c-47f9-b804-8660fb804279-kube-api-access-mpsf4\") pod \"cert-manager-cainjector-559cdd8c87-vfbcc\" (UID: \"8506cc19-270c-47f9-b804-8660fb804279\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"
Jul 26 15:13:00.809720 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.809687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8506cc19-270c-47f9-b804-8660fb804279-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vfbcc\" (UID: \"8506cc19-270c-47f9-b804-8660fb804279\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"
Jul 26 15:13:00.809822 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.809760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpsf4\" (UniqueName: \"kubernetes.io/projected/8506cc19-270c-47f9-b804-8660fb804279-kube-api-access-mpsf4\") pod \"cert-manager-cainjector-559cdd8c87-vfbcc\" (UID: \"8506cc19-270c-47f9-b804-8660fb804279\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"
Jul 26 15:13:00.956574 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:00.956511    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"
Jul 26 15:13:01.086136 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:01.086079    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc"]
Jul 26 15:13:01.088193 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:13:01.088164    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8506cc19_270c_47f9_b804_8660fb804279.slice/crio-f592756ce59c6fa6ad0ef1d8cde7b3f969b1391b1e8155c9c440945203b82c70 WatchSource:0}: Error finding container f592756ce59c6fa6ad0ef1d8cde7b3f969b1391b1e8155c9c440945203b82c70: Status 404 returned error can't find the container with id f592756ce59c6fa6ad0ef1d8cde7b3f969b1391b1e8155c9c440945203b82c70
Jul 26 15:13:01.845419 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:01.845380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc" event={"ID":"8506cc19-270c-47f9-b804-8660fb804279","Type":"ContainerStarted","Data":"f592756ce59c6fa6ad0ef1d8cde7b3f969b1391b1e8155c9c440945203b82c70"}
Jul 26 15:13:03.560346 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.560317    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pb6pz"]
Jul 26 15:13:03.564022 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.564004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:03.566656 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.566632    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-frjv4\""
Jul 26 15:13:03.574854 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.574835    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pb6pz"]
Jul 26 15:13:03.625959 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.625922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km56n\" (UniqueName: \"kubernetes.io/projected/19e6cb72-5de2-41c8-a337-c1e24dddf2f0-kube-api-access-km56n\") pod \"cert-manager-webhook-6486ffd997-pb6pz\" (UID: \"19e6cb72-5de2-41c8-a337-c1e24dddf2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:03.626109 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.626046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19e6cb72-5de2-41c8-a337-c1e24dddf2f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pb6pz\" (UID: \"19e6cb72-5de2-41c8-a337-c1e24dddf2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:03.726723 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.726687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km56n\" (UniqueName: \"kubernetes.io/projected/19e6cb72-5de2-41c8-a337-c1e24dddf2f0-kube-api-access-km56n\") pod \"cert-manager-webhook-6486ffd997-pb6pz\" (UID: \"19e6cb72-5de2-41c8-a337-c1e24dddf2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:03.726929 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.726769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19e6cb72-5de2-41c8-a337-c1e24dddf2f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pb6pz\" (UID: \"19e6cb72-5de2-41c8-a337-c1e24dddf2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:03.737959 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.737933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19e6cb72-5de2-41c8-a337-c1e24dddf2f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pb6pz\" (UID: \"19e6cb72-5de2-41c8-a337-c1e24dddf2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:03.738099 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.738079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km56n\" (UniqueName: \"kubernetes.io/projected/19e6cb72-5de2-41c8-a337-c1e24dddf2f0-kube-api-access-km56n\") pod \"cert-manager-webhook-6486ffd997-pb6pz\" (UID: \"19e6cb72-5de2-41c8-a337-c1e24dddf2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:03.875465 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:03.875380    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:04.268621 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:04.268541    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pb6pz"]
Jul 26 15:13:04.271005 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:13:04.270983    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19e6cb72_5de2_41c8_a337_c1e24dddf2f0.slice/crio-b0e9781169b0cbcc16162e4cd648f37f1451e8aa4a7276a50f333703eada17b7 WatchSource:0}: Error finding container b0e9781169b0cbcc16162e4cd648f37f1451e8aa4a7276a50f333703eada17b7: Status 404 returned error can't find the container with id b0e9781169b0cbcc16162e4cd648f37f1451e8aa4a7276a50f333703eada17b7
Jul 26 15:13:04.860671 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:04.860635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc" event={"ID":"8506cc19-270c-47f9-b804-8660fb804279","Type":"ContainerStarted","Data":"c67aa878af983d5c5896df756f6f144a3186b86a27669571ec99e2854d09417a"}
Jul 26 15:13:04.862129 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:04.862103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz" event={"ID":"19e6cb72-5de2-41c8-a337-c1e24dddf2f0","Type":"ContainerStarted","Data":"1a06f7749ee3d0dddc4475783f211055080473d5bdaf970c15b30f2c339e851d"}
Jul 26 15:13:04.862243 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:04.862141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz" event={"ID":"19e6cb72-5de2-41c8-a337-c1e24dddf2f0","Type":"ContainerStarted","Data":"b0e9781169b0cbcc16162e4cd648f37f1451e8aa4a7276a50f333703eada17b7"}
Jul 26 15:13:04.862243 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:04.862159    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:04.877735 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:04.877689    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vfbcc" podStartSLOduration=1.759642386 podStartE2EDuration="4.877675409s" totalImagesPullingTime="3.118033023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:13:04.876288426 +0000 UTC m=+474.249338206" watchObservedRunningTime="2026-07-26 15:13:04.877675409 +0000 UTC m=+474.250725189"
Jul 26 15:13:10.868316 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:10.868281    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz"
Jul 26 15:13:10.884736 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:10.884690    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pb6pz" podStartSLOduration=7.884674711 podStartE2EDuration="7.884674711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:13:04.897778637 +0000 UTC m=+474.270828415" watchObservedRunningTime="2026-07-26 15:13:10.884674711 +0000 UTC m=+480.257724489"
Jul 26 15:13:32.462121 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.462087    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"]
Jul 26 15:13:32.468645 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.468619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.471539 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.471517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 26 15:13:32.471643 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.471621    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 26 15:13:32.471705 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.471661    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 26 15:13:32.471754 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.471721    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 26 15:13:32.471996 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.471980    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7bw26\""
Jul 26 15:13:32.484614 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.484596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"]
Jul 26 15:13:32.558983 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.558959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjrgq\" (UniqueName: \"kubernetes.io/projected/33c00ffd-2a50-4b13-8264-e661f22fafc7-kube-api-access-wjrgq\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.559135 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.558996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33c00ffd-2a50-4b13-8264-e661f22fafc7-tmp\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.559135 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.559028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33c00ffd-2a50-4b13-8264-e661f22fafc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.559135 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.559099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33c00ffd-2a50-4b13-8264-e661f22fafc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.559253 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.559142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33c00ffd-2a50-4b13-8264-e661f22fafc7-manifests\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.660307 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.660277    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33c00ffd-2a50-4b13-8264-e661f22fafc7-manifests\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.660428 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.660329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjrgq\" (UniqueName: \"kubernetes.io/projected/33c00ffd-2a50-4b13-8264-e661f22fafc7-kube-api-access-wjrgq\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.660428 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.660363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33c00ffd-2a50-4b13-8264-e661f22fafc7-tmp\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.660428 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.660393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33c00ffd-2a50-4b13-8264-e661f22fafc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.660428 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.660418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33c00ffd-2a50-4b13-8264-e661f22fafc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.660649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.660631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33c00ffd-2a50-4b13-8264-e661f22fafc7-manifests\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.662707 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.662687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33c00ffd-2a50-4b13-8264-e661f22fafc7-tmp\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.662934 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.662914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33c00ffd-2a50-4b13-8264-e661f22fafc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.663003 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.662918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33c00ffd-2a50-4b13-8264-e661f22fafc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.673867 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.673845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjrgq\" (UniqueName: \"kubernetes.io/projected/33c00ffd-2a50-4b13-8264-e661f22fafc7-kube-api-access-wjrgq\") pod \"opendatahub-operator-controller-manager-5c55b8954b-fz6mb\" (UID: \"33c00ffd-2a50-4b13-8264-e661f22fafc7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.779216 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.779185    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:32.914176 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.914036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"]
Jul 26 15:13:32.916668 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:13:32.916642    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c00ffd_2a50_4b13_8264_e661f22fafc7.slice/crio-4c26e4be5ce48d8299a2607808707c6c4cb09116e59a28e2a700a6f47845068a WatchSource:0}: Error finding container 4c26e4be5ce48d8299a2607808707c6c4cb09116e59a28e2a700a6f47845068a: Status 404 returned error can't find the container with id 4c26e4be5ce48d8299a2607808707c6c4cb09116e59a28e2a700a6f47845068a
Jul 26 15:13:32.983621 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:32.983590    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb" event={"ID":"33c00ffd-2a50-4b13-8264-e661f22fafc7","Type":"ContainerStarted","Data":"4c26e4be5ce48d8299a2607808707c6c4cb09116e59a28e2a700a6f47845068a"}
Jul 26 15:13:37.005934 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:37.005870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb" event={"ID":"33c00ffd-2a50-4b13-8264-e661f22fafc7","Type":"ContainerStarted","Data":"d2b9955f8fae867bb0f209bfec0b2da761523b0ea4d9c47fcd6ecae9eb5425ff"}
Jul 26 15:13:38.011919 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:38.011864    2580 generic.go:356] "Generic (PLEG): container finished" podID="33c00ffd-2a50-4b13-8264-e661f22fafc7" containerID="d2b9955f8fae867bb0f209bfec0b2da761523b0ea4d9c47fcd6ecae9eb5425ff" exitCode=0
Jul 26 15:13:38.012301 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:38.011946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb" event={"ID":"33c00ffd-2a50-4b13-8264-e661f22fafc7","Type":"ContainerDied","Data":"d2b9955f8fae867bb0f209bfec0b2da761523b0ea4d9c47fcd6ecae9eb5425ff"}
Jul 26 15:13:39.017559 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:39.017522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb" event={"ID":"33c00ffd-2a50-4b13-8264-e661f22fafc7","Type":"ContainerStarted","Data":"7d636ad4023328a5a6759e2642cb5e0678bf96821f98d24d49b649c84eebd3fb"}
Jul 26 15:13:39.018050 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:39.017615    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:39.039345 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:39.039297    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb" podStartSLOduration=2.493379968 podStartE2EDuration="7.039283073s" totalImagesPullingTime="3.493807214s" totalInitContainerRuntime="1.052095891s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:13:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:13:39.037837855 +0000 UTC m=+508.410887635" watchObservedRunningTime="2026-07-26 15:13:39.039283073 +0000 UTC m=+508.412332851"
Jul 26 15:13:49.941494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.941460    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"]
Jul 26 15:13:49.950367 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.950343    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:49.951736 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.951713    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"]
Jul 26 15:13:49.953077 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.953055    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 26 15:13:49.953186 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.953087    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:13:49.954454 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.954432    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 26 15:13:49.954454 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.954445    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8nqg9\""
Jul 26 15:13:49.954619 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.954502    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 26 15:13:49.954683 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:49.954671    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 26 15:13:50.007088 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.007062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e16de25c-4d50-4556-8cf8-950c62273ef0-cert\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.007214 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.007098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e16de25c-4d50-4556-8cf8-950c62273ef0-metrics-cert\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.007214 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.007129    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e16de25c-4d50-4556-8cf8-950c62273ef0-manager-config\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.007310 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.007230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjbm2\" (UniqueName: \"kubernetes.io/projected/e16de25c-4d50-4556-8cf8-950c62273ef0-kube-api-access-rjbm2\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.023490 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.023466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c55b8954b-fz6mb"
Jul 26 15:13:50.108397 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.108364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e16de25c-4d50-4556-8cf8-950c62273ef0-cert\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.108568 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.108407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e16de25c-4d50-4556-8cf8-950c62273ef0-metrics-cert\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.108568 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.108446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e16de25c-4d50-4556-8cf8-950c62273ef0-manager-config\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.108685 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.108564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjbm2\" (UniqueName: \"kubernetes.io/projected/e16de25c-4d50-4556-8cf8-950c62273ef0-kube-api-access-rjbm2\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.109183 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.109154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e16de25c-4d50-4556-8cf8-950c62273ef0-manager-config\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.110781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.110759    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e16de25c-4d50-4556-8cf8-950c62273ef0-metrics-cert\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.110870 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.110826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e16de25c-4d50-4556-8cf8-950c62273ef0-cert\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.123305 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.123273    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjbm2\" (UniqueName: \"kubernetes.io/projected/e16de25c-4d50-4556-8cf8-950c62273ef0-kube-api-access-rjbm2\") pod \"lws-controller-manager-694b8c44c9-tfm5l\" (UID: \"e16de25c-4d50-4556-8cf8-950c62273ef0\") " pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.261881 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.261813    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:50.388361 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:50.388335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"]
Jul 26 15:13:50.390503 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:13:50.390475    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16de25c_4d50_4556_8cf8_950c62273ef0.slice/crio-99d9e7d0f3df902423c8919e14688455d7f706e063f55df06a863efe8c6dfb05 WatchSource:0}: Error finding container 99d9e7d0f3df902423c8919e14688455d7f706e063f55df06a863efe8c6dfb05: Status 404 returned error can't find the container with id 99d9e7d0f3df902423c8919e14688455d7f706e063f55df06a863efe8c6dfb05
Jul 26 15:13:51.069271 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:51.069236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l" event={"ID":"e16de25c-4d50-4556-8cf8-950c62273ef0","Type":"ContainerStarted","Data":"99d9e7d0f3df902423c8919e14688455d7f706e063f55df06a863efe8c6dfb05"}
Jul 26 15:13:53.079945 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.079907    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l" event={"ID":"e16de25c-4d50-4556-8cf8-950c62273ef0","Type":"ContainerStarted","Data":"9b13b935ecea92ce9f1c07412aea2d75b3516fd4391e3c2622feceb243518acb"}
Jul 26 15:13:53.080307 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.079999    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:13:53.099668 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.099582    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l" podStartSLOduration=1.64263455 podStartE2EDuration="4.099568549s" totalImagesPullingTime="2.456933999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:13:53.097783428 +0000 UTC m=+522.470833208" watchObservedRunningTime="2026-07-26 15:13:53.099568549 +0000 UTC m=+522.472618327"
Jul 26 15:13:53.371702 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.371614    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltzmk"]
Jul 26 15:13:53.375286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.375265    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:53.378311 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.378292    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-59nrg\""
Jul 26 15:13:53.378411 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.378333    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 26 15:13:53.383395 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.383374    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltzmk"]
Jul 26 15:13:53.431137 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.431111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae7215db-95af-4feb-8794-2ff03f1a89a2-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltzmk\" (UID: \"ae7215db-95af-4feb-8794-2ff03f1a89a2\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:53.431267 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.431250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5mwr\" (UniqueName: \"kubernetes.io/projected/ae7215db-95af-4feb-8794-2ff03f1a89a2-kube-api-access-v5mwr\") pod \"model-serving-api-54d89bd5fc-ltzmk\" (UID: \"ae7215db-95af-4feb-8794-2ff03f1a89a2\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:53.532081 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.532040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mwr\" (UniqueName: \"kubernetes.io/projected/ae7215db-95af-4feb-8794-2ff03f1a89a2-kube-api-access-v5mwr\") pod \"model-serving-api-54d89bd5fc-ltzmk\" (UID: \"ae7215db-95af-4feb-8794-2ff03f1a89a2\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:53.532081 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.532085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae7215db-95af-4feb-8794-2ff03f1a89a2-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltzmk\" (UID: \"ae7215db-95af-4feb-8794-2ff03f1a89a2\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:53.534414 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.534385    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae7215db-95af-4feb-8794-2ff03f1a89a2-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltzmk\" (UID: \"ae7215db-95af-4feb-8794-2ff03f1a89a2\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:53.539773 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.539748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5mwr\" (UniqueName: \"kubernetes.io/projected/ae7215db-95af-4feb-8794-2ff03f1a89a2-kube-api-access-v5mwr\") pod \"model-serving-api-54d89bd5fc-ltzmk\" (UID: \"ae7215db-95af-4feb-8794-2ff03f1a89a2\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:53.686702 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:53.686645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:54.017863 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:54.017839    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltzmk"]
Jul 26 15:13:54.020139 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:13:54.020109    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7215db_95af_4feb_8794_2ff03f1a89a2.slice/crio-5bbe93c8469f49ef4df289dc64eb1d17686f7158eba92730ddbb9dbb43a3217c WatchSource:0}: Error finding container 5bbe93c8469f49ef4df289dc64eb1d17686f7158eba92730ddbb9dbb43a3217c: Status 404 returned error can't find the container with id 5bbe93c8469f49ef4df289dc64eb1d17686f7158eba92730ddbb9dbb43a3217c
Jul 26 15:13:54.084718 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:54.084685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk" event={"ID":"ae7215db-95af-4feb-8794-2ff03f1a89a2","Type":"ContainerStarted","Data":"5bbe93c8469f49ef4df289dc64eb1d17686f7158eba92730ddbb9dbb43a3217c"}
Jul 26 15:13:56.099621 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:56.099586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk" event={"ID":"ae7215db-95af-4feb-8794-2ff03f1a89a2","Type":"ContainerStarted","Data":"f790e6d34aeaa9c218a40e973759adb51805256c89e027e7c4ba143b6e7980cf"}
Jul 26 15:13:56.100026 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:56.099671    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:13:56.116761 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:13:56.116709    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk" podStartSLOduration=1.444009998 podStartE2EDuration="3.116694755s" totalImagesPullingTime="1.672684757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:13:56.115703034 +0000 UTC m=+525.488752812" watchObservedRunningTime="2026-07-26 15:13:56.116694755 +0000 UTC m=+525.489744534"
Jul 26 15:14:00.135164 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.135129    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"]
Jul 26 15:14:00.138565 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.138548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.141421 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.141398    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 26 15:14:00.141421 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.141398    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7ljhm\""
Jul 26 15:14:00.150292 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.150267    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"]
Jul 26 15:14:00.183274 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.183403 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.183403 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.183498 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.183498 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183481    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.183573 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwnnk\" (UniqueName: \"kubernetes.io/projected/e1655dcf-c154-4baa-a6df-eea77f57bc63-kube-api-access-vwnnk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.183608 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.183646 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1655dcf-c154-4baa-a6df-eea77f57bc63-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.183689 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.183657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.284734 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.284701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.284990 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.284970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285167 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwnnk\" (UniqueName: \"kubernetes.io/projected/e1655dcf-c154-4baa-a6df-eea77f57bc63-kube-api-access-vwnnk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285305 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285410 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1655dcf-c154-4baa-a6df-eea77f57bc63-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285598 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285732 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285732 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285732 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285732 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.285997 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.285880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.286189 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.286168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1655dcf-c154-4baa-a6df-eea77f57bc63-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.286330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.286168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.286460 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.286302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.288291 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.288262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.288910 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.288872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.296385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.296358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1655dcf-c154-4baa-a6df-eea77f57bc63-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.296520 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.296407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwnnk\" (UniqueName: \"kubernetes.io/projected/e1655dcf-c154-4baa-a6df-eea77f57bc63-kube-api-access-vwnnk\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx\" (UID: \"e1655dcf-c154-4baa-a6df-eea77f57bc63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.449734 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.449658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:00.581446 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:00.581423    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"]
Jul 26 15:14:00.583839 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:14:00.583811    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1655dcf_c154_4baa_a6df_eea77f57bc63.slice/crio-5d24fc8e7efb1490e80f8852bb5d3e52e78aa3cd5095e57484b8bae4ca35b403 WatchSource:0}: Error finding container 5d24fc8e7efb1490e80f8852bb5d3e52e78aa3cd5095e57484b8bae4ca35b403: Status 404 returned error can't find the container with id 5d24fc8e7efb1490e80f8852bb5d3e52e78aa3cd5095e57484b8bae4ca35b403
Jul 26 15:14:01.123129 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:01.123097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx" event={"ID":"e1655dcf-c154-4baa-a6df-eea77f57bc63","Type":"ContainerStarted","Data":"5d24fc8e7efb1490e80f8852bb5d3e52e78aa3cd5095e57484b8bae4ca35b403"}
Jul 26 15:14:02.199125 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.199081    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"]
Jul 26 15:14:02.202618 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.202597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.205443 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.205420    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 26 15:14:02.205443 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.205435    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 26 15:14:02.205610 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.205548    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 26 15:14:02.205610 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.205569    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2lvbp\""
Jul 26 15:14:02.214037 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.213920    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"]
Jul 26 15:14:02.306484 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.306449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.306639 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.306493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.306639 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.306574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.306639 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.306591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6777\" (UniqueName: \"kubernetes.io/projected/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-kube-api-access-f6777\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.306639 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.306631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.306822 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.306656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.306822 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.306671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.408004 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.407959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.408146 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.408055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.408146 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.408085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6777\" (UniqueName: \"kubernetes.io/projected/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-kube-api-access-f6777\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.408258 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.408236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.408377 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.408357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.408469 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.408393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.408525 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.408483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.409243 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.409182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.410556 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.410528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.410672 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.410569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.410811 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.410790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.411549 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.411522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.423056 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.423037    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6777\" (UniqueName: \"kubernetes.io/projected/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-kube-api-access-f6777\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.427257 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.427239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbcd7451-4b20-4c10-b0c2-65e9c83785fb-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fxlpd\" (UID: \"bbcd7451-4b20-4c10-b0c2-65e9c83785fb\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:02.515527 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:02.515456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:03.524757 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:03.524696    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:14:03.525285 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:03.524809    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:14:03.525285 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:03.524883    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:14:03.669594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:03.669503    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"]
Jul 26 15:14:04.087612 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:04.087584    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-694b8c44c9-tfm5l"
Jul 26 15:14:04.139556 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:04.139515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx" event={"ID":"e1655dcf-c154-4baa-a6df-eea77f57bc63","Type":"ContainerStarted","Data":"8a7d56da662eb92bd2d0351f3d36c0d5641f8d71c1cafa881cf0675def66bf71"}
Jul 26 15:14:04.140793 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:04.140770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd" event={"ID":"bbcd7451-4b20-4c10-b0c2-65e9c83785fb","Type":"ContainerStarted","Data":"3da6299afacbb89dd0ce0e80742e86c3fb5d97acda21fbf73fa8706e6484c523"}
Jul 26 15:14:04.163502 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:04.163457    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx" podStartSLOduration=1.225627413 podStartE2EDuration="4.163440404s" totalImagesPullingTime="2.937812991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:14:04.161775936 +0000 UTC m=+533.534825718" watchObservedRunningTime="2026-07-26 15:14:04.163440404 +0000 UTC m=+533.536490182"
Jul 26 15:14:04.450855 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:04.450772    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:04.456418 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:04.456389    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:05.146767 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:05.146735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:05.147807 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:05.147785    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx"
Jul 26 15:14:05.907568 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:05.907536    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:14:05.907636 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:05.907600    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:14:06.154998 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:06.154966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd" event={"ID":"bbcd7451-4b20-4c10-b0c2-65e9c83785fb","Type":"ContainerStarted","Data":"7797f4e73039b8bc213344cb032239d134fea239599bf20cfdc74e331c3b39a5"}
Jul 26 15:14:06.155404 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:06.155034    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:14:06.156860 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:06.156804    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fxlpd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 15:14:06.156860 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:06.156851    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd" podUID="bbcd7451-4b20-4c10-b0c2-65e9c83785fb" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 15:14:07.107508 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:07.107478    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ltzmk"
Jul 26 15:14:07.128096 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:07.128038    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd" podStartSLOduration=2.892820261 podStartE2EDuration="5.128024052s" totalImagesPullingTime="2.235203791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:14:06.180879058 +0000 UTC m=+535.553928832" watchObservedRunningTime="2026-07-26 15:14:07.128024052 +0000 UTC m=+536.501073831"
Jul 26 15:14:07.160360 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:14:07.160338    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fxlpd"
Jul 26 15:15:45.385841 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:15:45.385807    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659fbc9ff9-64j76"]
Jul 26 15:16:10.407828 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.407784    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-659fbc9ff9-64j76" podUID="7894211b-ea2e-48ff-bfc8-9f60a1aace97" containerName="console" containerID="cri-o://806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799" gracePeriod=15
Jul 26 15:16:10.658523 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.658469    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:16:10.701145 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.701108    2580 generic.go:356] "Generic (PLEG): container finished" podID="7894211b-ea2e-48ff-bfc8-9f60a1aace97" containerID="806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799" exitCode=0
Jul 26 15:16:10.701266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.701165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fbc9ff9-64j76" event={"ID":"7894211b-ea2e-48ff-bfc8-9f60a1aace97","Type":"ContainerDied","Data":"806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799"}
Jul 26 15:16:10.701266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.701230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659fbc9ff9-64j76" event={"ID":"7894211b-ea2e-48ff-bfc8-9f60a1aace97","Type":"ContainerDied","Data":"e232a0080cebf1e7ee161235ed54a9e61c7632dac865c57591a6ea040f1dc15c"}
Jul 26 15:16:10.701266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.701168    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659fbc9ff9-64j76"
Jul 26 15:16:10.701266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.701259    2580 scope.go:117] "RemoveContainer" containerID="806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799"
Jul 26 15:16:10.711722 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.711705    2580 scope.go:117] "RemoveContainer" containerID="806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799"
Jul 26 15:16:10.711999 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:16:10.711979    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799\": container with ID starting with 806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799 not found: ID does not exist" containerID="806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799"
Jul 26 15:16:10.712075 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.712010    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799"} err="failed to get container status \"806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799\": rpc error: code = NotFound desc = could not find container \"806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799\": container with ID starting with 806acc53f366436c3e0430dcf34a2cca8e0f72fb3c0cff0917c57f7482ac3799 not found: ID does not exist"
Jul 26 15:16:10.812529 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.812502    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-oauth-config\") pod \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") "
Jul 26 15:16:10.812649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.812558    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-config\") pod \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") "
Jul 26 15:16:10.812649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.812579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-serving-cert\") pod \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") "
Jul 26 15:16:10.812649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.812609    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-oauth-serving-cert\") pod \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") "
Jul 26 15:16:10.812649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.812630    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-trusted-ca-bundle\") pod \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") "
Jul 26 15:16:10.812859 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.812716    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-service-ca\") pod \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") "
Jul 26 15:16:10.812859 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.812738    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2kpt\" (UniqueName: \"kubernetes.io/projected/7894211b-ea2e-48ff-bfc8-9f60a1aace97-kube-api-access-t2kpt\") pod \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\" (UID: \"7894211b-ea2e-48ff-bfc8-9f60a1aace97\") "
Jul 26 15:16:10.813161 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.813123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7894211b-ea2e-48ff-bfc8-9f60a1aace97" (UID: "7894211b-ea2e-48ff-bfc8-9f60a1aace97"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:16:10.813278 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.813155    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-config" (OuterVolumeSpecName: "console-config") pod "7894211b-ea2e-48ff-bfc8-9f60a1aace97" (UID: "7894211b-ea2e-48ff-bfc8-9f60a1aace97"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:16:10.813278 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.813164    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7894211b-ea2e-48ff-bfc8-9f60a1aace97" (UID: "7894211b-ea2e-48ff-bfc8-9f60a1aace97"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:16:10.813367 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.813285    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-service-ca" (OuterVolumeSpecName: "service-ca") pod "7894211b-ea2e-48ff-bfc8-9f60a1aace97" (UID: "7894211b-ea2e-48ff-bfc8-9f60a1aace97"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:16:10.814799 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.814778    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7894211b-ea2e-48ff-bfc8-9f60a1aace97-kube-api-access-t2kpt" (OuterVolumeSpecName: "kube-api-access-t2kpt") pod "7894211b-ea2e-48ff-bfc8-9f60a1aace97" (UID: "7894211b-ea2e-48ff-bfc8-9f60a1aace97"). InnerVolumeSpecName "kube-api-access-t2kpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:16:10.815080 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.815062    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7894211b-ea2e-48ff-bfc8-9f60a1aace97" (UID: "7894211b-ea2e-48ff-bfc8-9f60a1aace97"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:16:10.815169 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.815081    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7894211b-ea2e-48ff-bfc8-9f60a1aace97" (UID: "7894211b-ea2e-48ff-bfc8-9f60a1aace97"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:16:10.914139 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.914068    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:16:10.914139 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.914095    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2kpt\" (UniqueName: \"kubernetes.io/projected/7894211b-ea2e-48ff-bfc8-9f60a1aace97-kube-api-access-t2kpt\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:16:10.914139 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.914110    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-oauth-config\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:16:10.914139 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.914118    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-config\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:16:10.914139 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.914127    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7894211b-ea2e-48ff-bfc8-9f60a1aace97-console-serving-cert\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:16:10.914139 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.914135    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-oauth-serving-cert\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:16:10.914139 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:10.914144    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7894211b-ea2e-48ff-bfc8-9f60a1aace97-trusted-ca-bundle\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:16:11.022625 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:11.022600    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659fbc9ff9-64j76"]
Jul 26 15:16:11.028211 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:11.028173    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-659fbc9ff9-64j76"]
Jul 26 15:16:11.159456 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:11.159428    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7894211b-ea2e-48ff-bfc8-9f60a1aace97" path="/var/lib/kubelet/pods/7894211b-ea2e-48ff-bfc8-9f60a1aace97/volumes"
Jul 26 15:16:11.604985 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:11.604947    2580 patch_prober.go:28] interesting pod/console-659fbc9ff9-64j76 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.22:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 15:16:11.605370 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:11.605023    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-659fbc9ff9-64j76" podUID="7894211b-ea2e-48ff-bfc8-9f60a1aace97" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 26 15:16:57.562106 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.558570    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-766dd44bbb-2fgtl"]
Jul 26 15:16:57.562106 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.559439    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7894211b-ea2e-48ff-bfc8-9f60a1aace97" containerName="console"
Jul 26 15:16:57.562106 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.559456    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7894211b-ea2e-48ff-bfc8-9f60a1aace97" containerName="console"
Jul 26 15:16:57.562106 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.559609    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7894211b-ea2e-48ff-bfc8-9f60a1aace97" containerName="console"
Jul 26 15:16:57.565665 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.565635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:16:57.568309 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.568287    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 26 15:16:57.568430 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.568335    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 26 15:16:57.568430 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.568352    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ccgw4\""
Jul 26 15:16:57.572295 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.572271    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-766dd44bbb-2fgtl"]
Jul 26 15:16:57.669155 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.669119    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4jk2\" (UniqueName: \"kubernetes.io/projected/85af1ec6-8e1a-4703-9805-881e80c79021-kube-api-access-g4jk2\") pod \"maas-controller-766dd44bbb-2fgtl\" (UID: \"85af1ec6-8e1a-4703-9805-881e80c79021\") " pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:16:57.669310 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.669165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85af1ec6-8e1a-4703-9805-881e80c79021-webhook-cert\") pod \"maas-controller-766dd44bbb-2fgtl\" (UID: \"85af1ec6-8e1a-4703-9805-881e80c79021\") " pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:16:57.769611 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.769580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4jk2\" (UniqueName: \"kubernetes.io/projected/85af1ec6-8e1a-4703-9805-881e80c79021-kube-api-access-g4jk2\") pod \"maas-controller-766dd44bbb-2fgtl\" (UID: \"85af1ec6-8e1a-4703-9805-881e80c79021\") " pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:16:57.769750 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.769623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85af1ec6-8e1a-4703-9805-881e80c79021-webhook-cert\") pod \"maas-controller-766dd44bbb-2fgtl\" (UID: \"85af1ec6-8e1a-4703-9805-881e80c79021\") " pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:16:57.771916 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.771880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85af1ec6-8e1a-4703-9805-881e80c79021-webhook-cert\") pod \"maas-controller-766dd44bbb-2fgtl\" (UID: \"85af1ec6-8e1a-4703-9805-881e80c79021\") " pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:16:57.777837 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.777818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4jk2\" (UniqueName: \"kubernetes.io/projected/85af1ec6-8e1a-4703-9805-881e80c79021-kube-api-access-g4jk2\") pod \"maas-controller-766dd44bbb-2fgtl\" (UID: \"85af1ec6-8e1a-4703-9805-881e80c79021\") " pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:16:57.876948 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:57.876870    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:16:58.001805 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:58.001781    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-766dd44bbb-2fgtl"]
Jul 26 15:16:58.004002 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:16:58.003958    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85af1ec6_8e1a_4703_9805_881e80c79021.slice/crio-d5cd3d8d02afae5096da4403a224431a348b74a1feb0b42b9c22b4fae5685bdc WatchSource:0}: Error finding container d5cd3d8d02afae5096da4403a224431a348b74a1feb0b42b9c22b4fae5685bdc: Status 404 returned error can't find the container with id d5cd3d8d02afae5096da4403a224431a348b74a1feb0b42b9c22b4fae5685bdc
Jul 26 15:16:58.005524 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:58.005503    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:16:58.912504 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:16:58.912467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766dd44bbb-2fgtl" event={"ID":"85af1ec6-8e1a-4703-9805-881e80c79021","Type":"ContainerStarted","Data":"d5cd3d8d02afae5096da4403a224431a348b74a1feb0b42b9c22b4fae5685bdc"}
Jul 26 15:17:00.924445 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:00.924410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766dd44bbb-2fgtl" event={"ID":"85af1ec6-8e1a-4703-9805-881e80c79021","Type":"ContainerStarted","Data":"675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6"}
Jul 26 15:17:00.924833 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:00.924540    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:17:00.941530 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:00.941476    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-766dd44bbb-2fgtl" podStartSLOduration=1.765623269 podStartE2EDuration="3.941460146s" totalImagesPullingTime="2.175836877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:17:00.941354933 +0000 UTC m=+710.314404712" watchObservedRunningTime="2026-07-26 15:17:00.941460146 +0000 UTC m=+710.314509966"
Jul 26 15:17:11.930603 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:11.930526    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:17:30.514400 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.514360    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"]
Jul 26 15:17:30.517866 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.517848    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.523762 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.523734    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 26 15:17:30.523903 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.523819    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nnwcs\""
Jul 26 15:17:30.525053 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.525031    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 15:17:30.525168 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.525043    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 26 15:17:30.532122 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.532100    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"]
Jul 26 15:17:30.640970 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.640939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpn6c\" (UniqueName: \"kubernetes.io/projected/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-kube-api-access-tpn6c\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.641126 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.640981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-maas-api-tls\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.641126 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.641100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-openshift-service-ca\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.742279 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.742249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpn6c\" (UniqueName: \"kubernetes.io/projected/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-kube-api-access-tpn6c\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.742459 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.742289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-maas-api-tls\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.742459 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.742371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-openshift-service-ca\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.742957 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.742936    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-openshift-service-ca\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.744675 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.744654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-maas-api-tls\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.752782 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.752760    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpn6c\" (UniqueName: \"kubernetes.io/projected/f57fc9b4-0ae6-4d6d-a1fc-126c16f50132-kube-api-access-tpn6c\") pod \"maas-api-586ff7d7cc-rtb98\" (UID: \"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132\") " pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.828429 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.828403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:30.967554 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:30.967520    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"]
Jul 26 15:17:30.970294 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:17:30.970263    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57fc9b4_0ae6_4d6d_a1fc_126c16f50132.slice/crio-f04af10fe233923d80f6f427d20d36c4513ef2f9928c5d842adab3e524b3d0c4 WatchSource:0}: Error finding container f04af10fe233923d80f6f427d20d36c4513ef2f9928c5d842adab3e524b3d0c4: Status 404 returned error can't find the container with id f04af10fe233923d80f6f427d20d36c4513ef2f9928c5d842adab3e524b3d0c4
Jul 26 15:17:31.002984 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.002941    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-cfcqq"]
Jul 26 15:17:31.007346 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.007326    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:31.010117 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.010099    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xgdzp\""
Jul 26 15:17:31.010196 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.010100    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 26 15:17:31.018381 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.018364    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-cfcqq"]
Jul 26 15:17:31.059728 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.059703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98" event={"ID":"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132","Type":"ContainerStarted","Data":"f04af10fe233923d80f6f427d20d36c4513ef2f9928c5d842adab3e524b3d0c4"}
Jul 26 15:17:31.145917 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.145828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186e7423-63a1-4de7-8017-bf79a30146b1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-cfcqq\" (UID: \"186e7423-63a1-4de7-8017-bf79a30146b1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:31.145917 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.145863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fb2p\" (UniqueName: \"kubernetes.io/projected/186e7423-63a1-4de7-8017-bf79a30146b1-kube-api-access-9fb2p\") pod \"payload-processing-5cc6cd444b-cfcqq\" (UID: \"186e7423-63a1-4de7-8017-bf79a30146b1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:31.246829 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.246792    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186e7423-63a1-4de7-8017-bf79a30146b1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-cfcqq\" (UID: \"186e7423-63a1-4de7-8017-bf79a30146b1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:31.247004 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.246849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fb2p\" (UniqueName: \"kubernetes.io/projected/186e7423-63a1-4de7-8017-bf79a30146b1-kube-api-access-9fb2p\") pod \"payload-processing-5cc6cd444b-cfcqq\" (UID: \"186e7423-63a1-4de7-8017-bf79a30146b1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:31.247468 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.247448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/186e7423-63a1-4de7-8017-bf79a30146b1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-cfcqq\" (UID: \"186e7423-63a1-4de7-8017-bf79a30146b1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:31.259568 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.259544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fb2p\" (UniqueName: \"kubernetes.io/projected/186e7423-63a1-4de7-8017-bf79a30146b1-kube-api-access-9fb2p\") pod \"payload-processing-5cc6cd444b-cfcqq\" (UID: \"186e7423-63a1-4de7-8017-bf79a30146b1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:31.318703 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.318674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:31.458333 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:31.458306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-cfcqq"]
Jul 26 15:17:31.460263 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:17:31.460235    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186e7423_63a1_4de7_8017_bf79a30146b1.slice/crio-bb80cbe243f46d37f3dd6de36f499ec316abf833aeaa12bcf241f1ee4a234874 WatchSource:0}: Error finding container bb80cbe243f46d37f3dd6de36f499ec316abf833aeaa12bcf241f1ee4a234874: Status 404 returned error can't find the container with id bb80cbe243f46d37f3dd6de36f499ec316abf833aeaa12bcf241f1ee4a234874
Jul 26 15:17:32.070092 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:32.070051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq" event={"ID":"186e7423-63a1-4de7-8017-bf79a30146b1","Type":"ContainerStarted","Data":"bb80cbe243f46d37f3dd6de36f499ec316abf833aeaa12bcf241f1ee4a234874"}
Jul 26 15:17:33.077368 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:33.077343    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98" event={"ID":"f57fc9b4-0ae6-4d6d-a1fc-126c16f50132","Type":"ContainerStarted","Data":"3b90ef5538ff6ab59c5bff98fb70b95459b2598e21627b5cd2626f1a44ac3cde"}
Jul 26 15:17:33.077740 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:33.077498    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:33.095670 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:33.095619    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98" podStartSLOduration=1.547684552 podStartE2EDuration="3.095601322s" totalImagesPullingTime="1.54791677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:17:33.093472204 +0000 UTC m=+742.466521993" watchObservedRunningTime="2026-07-26 15:17:33.095601322 +0000 UTC m=+742.468651114"
Jul 26 15:17:34.083285 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:34.083240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq" event={"ID":"186e7423-63a1-4de7-8017-bf79a30146b1","Type":"ContainerStarted","Data":"92eba8328a6442e39492ab7a85d71840a405456cb53179e4487229f3014371cb"}
Jul 26 15:17:34.083696 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:34.083338    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:34.100522 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:34.100476    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq" podStartSLOduration=2.50787439 podStartE2EDuration="4.10046444s" totalImagesPullingTime="1.59259005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:17:34.09944925 +0000 UTC m=+743.472499029" watchObservedRunningTime="2026-07-26 15:17:34.10046444 +0000 UTC m=+743.473514218"
Jul 26 15:17:39.088489 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:39.088461    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-586ff7d7cc-rtb98"
Jul 26 15:17:45.090796 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:45.090761    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-cfcqq"
Jul 26 15:17:58.938556 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.938524    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"]
Jul 26 15:17:58.942362 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.942339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:58.945174 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.945153    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 26 15:17:58.946412 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.946385    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 26 15:17:58.946506 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.946413    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ks67c\""
Jul 26 15:17:58.946506 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.946447    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 26 15:17:58.952674 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.952650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"]
Jul 26 15:17:58.964655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.964633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:58.964777 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.964665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/135d54fe-9a13-4b1e-8d3f-59ba4c942574-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:58.964777 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.964716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6pch\" (UniqueName: \"kubernetes.io/projected/135d54fe-9a13-4b1e-8d3f-59ba4c942574-kube-api-access-f6pch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:58.964903 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.964784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:58.964903 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.964820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:58.964992 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:58.964920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.065774 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.065744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6pch\" (UniqueName: \"kubernetes.io/projected/135d54fe-9a13-4b1e-8d3f-59ba4c942574-kube-api-access-f6pch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.065965 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.065785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.065965 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.065806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.065965 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.065858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.065965 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.065918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.065965 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.065947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/135d54fe-9a13-4b1e-8d3f-59ba4c942574-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.066297 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.066264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.066417 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.066298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.066417 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.066345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.068116 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.068086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/135d54fe-9a13-4b1e-8d3f-59ba4c942574-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.068379 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.068362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/135d54fe-9a13-4b1e-8d3f-59ba4c942574-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.074082 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.074062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6pch\" (UniqueName: \"kubernetes.io/projected/135d54fe-9a13-4b1e-8d3f-59ba4c942574-kube-api-access-f6pch\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt\" (UID: \"135d54fe-9a13-4b1e-8d3f-59ba4c942574\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.254189 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.254101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:17:59.384066 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:17:59.384040    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"]
Jul 26 15:17:59.386057 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:17:59.386033    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135d54fe_9a13_4b1e_8d3f_59ba4c942574.slice/crio-9b4d6dc07011e3ed62f1da9b316db4a98834e140f7ec2dcdb33d57d575601ed7 WatchSource:0}: Error finding container 9b4d6dc07011e3ed62f1da9b316db4a98834e140f7ec2dcdb33d57d575601ed7: Status 404 returned error can't find the container with id 9b4d6dc07011e3ed62f1da9b316db4a98834e140f7ec2dcdb33d57d575601ed7
Jul 26 15:18:00.203670 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:00.203631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt" event={"ID":"135d54fe-9a13-4b1e-8d3f-59ba4c942574","Type":"ContainerStarted","Data":"9b4d6dc07011e3ed62f1da9b316db4a98834e140f7ec2dcdb33d57d575601ed7"}
Jul 26 15:18:01.210333 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:01.210297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt" event={"ID":"135d54fe-9a13-4b1e-8d3f-59ba4c942574","Type":"ContainerStarted","Data":"97e0f057a21fbef9a8fddd7765ad663167bd3ee33549d47f97920f13b54ee4d0"}
Jul 26 15:18:09.254598 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:09.254568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:18:09.255134 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:09.254791    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:18:09.267029 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:09.267006    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:18:09.283778 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:09.283742    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt" podStartSLOduration=10.240712878 podStartE2EDuration="11.283730167s" totalImagesPullingTime="1.043017289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:01.227106467 +0000 UTC m=+770.600156249" watchObservedRunningTime="2026-07-26 15:18:09.283730167 +0000 UTC m=+778.656779945"
Jul 26 15:18:10.261755 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:10.261728    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt"
Jul 26 15:18:57.039419 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.039381    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"]
Jul 26 15:18:57.042998 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.042979    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.045815 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.045797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 26 15:18:57.052489 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.052465    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"]
Jul 26 15:18:57.175321 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.175289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.175477 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.175330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.175477 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.175399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.175477 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.175425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbdt\" (UniqueName: \"kubernetes.io/projected/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-kube-api-access-wvbdt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.175477 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.175445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.175477 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.175468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.276323 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.276289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.276476 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.276334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.276476 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.276356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvbdt\" (UniqueName: \"kubernetes.io/projected/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-kube-api-access-wvbdt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.276553 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.276474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.276553 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.276513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.276654 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.276632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.276745 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.276716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.276929 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.276906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.277049 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.277027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.278691 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.278671    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.278817 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.278800    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.284415 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.284394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvbdt\" (UniqueName: \"kubernetes.io/projected/b0b031e1-cbf1-46b6-aed2-859a2c4a967a-kube-api-access-wvbdt\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-79crx\" (UID: \"b0b031e1-cbf1-46b6-aed2-859a2c4a967a\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.354086 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.354017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:18:57.483121 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:57.483098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"]
Jul 26 15:18:57.485213 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:18:57.485180    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b031e1_cbf1_46b6_aed2_859a2c4a967a.slice/crio-ae7e32febe7a451d02e864ba948ed343b988b17fee5b5086359f9c433895b0ed WatchSource:0}: Error finding container ae7e32febe7a451d02e864ba948ed343b988b17fee5b5086359f9c433895b0ed: Status 404 returned error can't find the container with id ae7e32febe7a451d02e864ba948ed343b988b17fee5b5086359f9c433895b0ed
Jul 26 15:18:58.470911 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:58.470855    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx" event={"ID":"b0b031e1-cbf1-46b6-aed2-859a2c4a967a","Type":"ContainerStarted","Data":"27a625058609499286c3fe52365088775b76ab501626641ef1a77aaa494df101"}
Jul 26 15:18:58.471280 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:58.470933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx" event={"ID":"b0b031e1-cbf1-46b6-aed2-859a2c4a967a","Type":"ContainerStarted","Data":"ae7e32febe7a451d02e864ba948ed343b988b17fee5b5086359f9c433895b0ed"}
Jul 26 15:18:58.491289 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:18:58.491243    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx" podStartSLOduration=1.295993408 podStartE2EDuration="1.491228559s" totalImagesPullingTime="195.235151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:18:58.489324057 +0000 UTC m=+827.862373841" watchObservedRunningTime="2026-07-26 15:18:58.491228559 +0000 UTC m=+827.864278338"
Jul 26 15:19:07.354900 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:19:07.354866    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:19:07.355360 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:19:07.354953    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:19:07.367384 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:19:07.367362    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:19:07.523231 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:19:07.523202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-79crx"
Jul 26 15:21:13.391073 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.391038    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-766dd44bbb-2fgtl"]
Jul 26 15:21:13.391610 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.391338    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-766dd44bbb-2fgtl" podUID="85af1ec6-8e1a-4703-9805-881e80c79021" containerName="manager" containerID="cri-o://675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6" gracePeriod=30
Jul 26 15:21:13.642322 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.642262    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:21:13.663107 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.663083    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4jk2\" (UniqueName: \"kubernetes.io/projected/85af1ec6-8e1a-4703-9805-881e80c79021-kube-api-access-g4jk2\") pod \"85af1ec6-8e1a-4703-9805-881e80c79021\" (UID: \"85af1ec6-8e1a-4703-9805-881e80c79021\") "
Jul 26 15:21:13.663226 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.663140    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85af1ec6-8e1a-4703-9805-881e80c79021-webhook-cert\") pod \"85af1ec6-8e1a-4703-9805-881e80c79021\" (UID: \"85af1ec6-8e1a-4703-9805-881e80c79021\") "
Jul 26 15:21:13.665380 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.665337    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85af1ec6-8e1a-4703-9805-881e80c79021-kube-api-access-g4jk2" (OuterVolumeSpecName: "kube-api-access-g4jk2") pod "85af1ec6-8e1a-4703-9805-881e80c79021" (UID: "85af1ec6-8e1a-4703-9805-881e80c79021"). InnerVolumeSpecName "kube-api-access-g4jk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:21:13.665380 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.665352    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85af1ec6-8e1a-4703-9805-881e80c79021-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "85af1ec6-8e1a-4703-9805-881e80c79021" (UID: "85af1ec6-8e1a-4703-9805-881e80c79021"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:21:13.764343 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.764313    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85af1ec6-8e1a-4703-9805-881e80c79021-webhook-cert\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:21:13.764343 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:13.764341    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4jk2\" (UniqueName: \"kubernetes.io/projected/85af1ec6-8e1a-4703-9805-881e80c79021-kube-api-access-g4jk2\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:21:14.096359 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.096328    2580 generic.go:356] "Generic (PLEG): container finished" podID="85af1ec6-8e1a-4703-9805-881e80c79021" containerID="675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6" exitCode=0
Jul 26 15:21:14.096519 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.096373    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-766dd44bbb-2fgtl"
Jul 26 15:21:14.096519 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.096406    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766dd44bbb-2fgtl" event={"ID":"85af1ec6-8e1a-4703-9805-881e80c79021","Type":"ContainerDied","Data":"675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6"}
Jul 26 15:21:14.096519 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.096471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-766dd44bbb-2fgtl" event={"ID":"85af1ec6-8e1a-4703-9805-881e80c79021","Type":"ContainerDied","Data":"d5cd3d8d02afae5096da4403a224431a348b74a1feb0b42b9c22b4fae5685bdc"}
Jul 26 15:21:14.096519 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.096498    2580 scope.go:117] "RemoveContainer" containerID="675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6"
Jul 26 15:21:14.105286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.105267    2580 scope.go:117] "RemoveContainer" containerID="675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6"
Jul 26 15:21:14.105543 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:21:14.105520    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6\": container with ID starting with 675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6 not found: ID does not exist" containerID="675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6"
Jul 26 15:21:14.105587 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.105555    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6"} err="failed to get container status \"675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6\": rpc error: code = NotFound desc = could not find container \"675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6\": container with ID starting with 675276f685bb72cbb0cdda34c74d05057d64c09aca85f3038a09dc80fa909ac6 not found: ID does not exist"
Jul 26 15:21:14.117634 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.117611    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-766dd44bbb-2fgtl"]
Jul 26 15:21:14.119373 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:14.119351    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-766dd44bbb-2fgtl"]
Jul 26 15:21:15.160079 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:21:15.160040    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85af1ec6-8e1a-4703-9805-881e80c79021" path="/var/lib/kubelet/pods/85af1ec6-8e1a-4703-9805-881e80c79021/volumes"
Jul 26 15:35:31.988729 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:31.988692    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"]
Jul 26 15:35:31.989323 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:31.989305    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85af1ec6-8e1a-4703-9805-881e80c79021" containerName="manager"
Jul 26 15:35:31.989367 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:31.989326    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="85af1ec6-8e1a-4703-9805-881e80c79021" containerName="manager"
Jul 26 15:35:31.989419 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:31.989407    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="85af1ec6-8e1a-4703-9805-881e80c79021" containerName="manager"
Jul 26 15:35:31.992814 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:31.992795    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:31.995655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:31.995634    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-50ce075b-serving-cert\""
Jul 26 15:35:32.001141 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.001086    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"]
Jul 26 15:35:32.079790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.079742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g45td\" (UniqueName: \"kubernetes.io/projected/19fa0203-3370-4725-8914-3afe43a03145-kube-api-access-g45td\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.079790 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.079785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.080057 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.079932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fa0203-3370-4725-8914-3afe43a03145-openshift-service-ca\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.180378 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.180339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fa0203-3370-4725-8914-3afe43a03145-openshift-service-ca\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.180590 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.180428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g45td\" (UniqueName: \"kubernetes.io/projected/19fa0203-3370-4725-8914-3afe43a03145-kube-api-access-g45td\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.180590 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.180447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.180714 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:35:32.180636    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-serving-cert: secret "maas-api-e2e-ait-50ce075b-serving-cert" not found
Jul 26 15:35:32.180714 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:35:32.180708    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls podName:19fa0203-3370-4725-8914-3afe43a03145 nodeName:}" failed. No retries permitted until 2026-07-26 15:35:32.680686038 +0000 UTC m=+1822.053735805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls") pod "maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr" (UID: "19fa0203-3370-4725-8914-3afe43a03145") : secret "maas-api-e2e-ait-50ce075b-serving-cert" not found
Jul 26 15:35:32.181143 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.181122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fa0203-3370-4725-8914-3afe43a03145-openshift-service-ca\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.194369 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.194337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g45td\" (UniqueName: \"kubernetes.io/projected/19fa0203-3370-4725-8914-3afe43a03145-kube-api-access-g45td\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.685332 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.685293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.687700 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.687674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls\") pod \"maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:32.712606 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.712576    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"]
Jul 26 15:35:32.716099 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.716083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:32.719042 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.719007    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-50ce075b-dockercfg-jlltw\""
Jul 26 15:35:32.719042 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.719007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-50ce075b\""
Jul 26 15:35:32.724049 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.724020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"]
Jul 26 15:35:32.786594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.786558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc6dj\" (UniqueName: \"kubernetes.io/projected/de4181a7-cb97-441f-b576-f2365cdbbe4d-kube-api-access-bc6dj\") pod \"payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn\" (UID: \"de4181a7-cb97-441f-b576-f2365cdbbe4d\") " pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:32.786769 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.786601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4181a7-cb97-441f-b576-f2365cdbbe4d-plugins-config-volume\") pod \"payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn\" (UID: \"de4181a7-cb97-441f-b576-f2365cdbbe4d\") " pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:32.887352 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.887319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc6dj\" (UniqueName: \"kubernetes.io/projected/de4181a7-cb97-441f-b576-f2365cdbbe4d-kube-api-access-bc6dj\") pod \"payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn\" (UID: \"de4181a7-cb97-441f-b576-f2365cdbbe4d\") " pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:32.887515 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.887357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4181a7-cb97-441f-b576-f2365cdbbe4d-plugins-config-volume\") pod \"payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn\" (UID: \"de4181a7-cb97-441f-b576-f2365cdbbe4d\") " pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:32.888049 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.888031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4181a7-cb97-441f-b576-f2365cdbbe4d-plugins-config-volume\") pod \"payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn\" (UID: \"de4181a7-cb97-441f-b576-f2365cdbbe4d\") " pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:32.895713 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.895687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc6dj\" (UniqueName: \"kubernetes.io/projected/de4181a7-cb97-441f-b576-f2365cdbbe4d-kube-api-access-bc6dj\") pod \"payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn\" (UID: \"de4181a7-cb97-441f-b576-f2365cdbbe4d\") " pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:32.905603 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:32.905582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:33.027467 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:33.027431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:33.037794 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:33.037770    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"]
Jul 26 15:35:33.039605 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:35:33.039581    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fa0203_3370_4725_8914_3afe43a03145.slice/crio-eba9d4583fccad6380cc77e32f5893f35f4960757bc702968daee8fec9fe1a6a WatchSource:0}: Error finding container eba9d4583fccad6380cc77e32f5893f35f4960757bc702968daee8fec9fe1a6a: Status 404 returned error can't find the container with id eba9d4583fccad6380cc77e32f5893f35f4960757bc702968daee8fec9fe1a6a
Jul 26 15:35:33.040823 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:33.040804    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:35:33.165532 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:33.165508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"]
Jul 26 15:35:33.168032 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:35:33.168007    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4181a7_cb97_441f_b576_f2365cdbbe4d.slice/crio-99112408861a3eca69e0809d9e2e13d7f10d3bd5769b4076daed490526ffb7c7 WatchSource:0}: Error finding container 99112408861a3eca69e0809d9e2e13d7f10d3bd5769b4076daed490526ffb7c7: Status 404 returned error can't find the container with id 99112408861a3eca69e0809d9e2e13d7f10d3bd5769b4076daed490526ffb7c7
Jul 26 15:35:34.014551 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:34.014463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr" event={"ID":"19fa0203-3370-4725-8914-3afe43a03145","Type":"ContainerStarted","Data":"99e3f7f6d6aa6c3af02b4eab6dbcd38588e166bc85a87d4d253e16fe2133a9b8"}
Jul 26 15:35:34.014551 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:34.014526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr" event={"ID":"19fa0203-3370-4725-8914-3afe43a03145","Type":"ContainerStarted","Data":"eba9d4583fccad6380cc77e32f5893f35f4960757bc702968daee8fec9fe1a6a"}
Jul 26 15:35:34.014779 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:34.014573    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:34.016107 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:34.016084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn" event={"ID":"de4181a7-cb97-441f-b576-f2365cdbbe4d","Type":"ContainerStarted","Data":"69eb8da53b0225437ed8949144c2e38dd8bfce74dc0c56ec7c920edcffd769be"}
Jul 26 15:35:34.016232 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:34.016121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn" event={"ID":"de4181a7-cb97-441f-b576-f2365cdbbe4d","Type":"ContainerStarted","Data":"99112408861a3eca69e0809d9e2e13d7f10d3bd5769b4076daed490526ffb7c7"}
Jul 26 15:35:34.016232 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:34.016144    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:35:34.031737 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:34.031690    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr" podStartSLOduration=2.535210964 podStartE2EDuration="3.031676416s" totalImagesPullingTime="496.465452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:35:34.030227769 +0000 UTC m=+1823.403277568" watchObservedRunningTime="2026-07-26 15:35:34.031676416 +0000 UTC m=+1823.404726195"
Jul 26 15:35:34.047946 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:34.047881    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn" podStartSLOduration=2.047866613 podStartE2EDuration="2.047866613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:35:34.04621611 +0000 UTC m=+1823.419265901" watchObservedRunningTime="2026-07-26 15:35:34.047866613 +0000 UTC m=+1823.420916391"
Jul 26 15:35:40.027268 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:40.027224    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:35:45.024090 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:35:45.024058    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:36:07.881625 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:07.881590    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"]
Jul 26 15:36:07.882081 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:07.881831    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr" podUID="19fa0203-3370-4725-8914-3afe43a03145" containerName="maas-api" containerID="cri-o://99e3f7f6d6aa6c3af02b4eab6dbcd38588e166bc85a87d4d253e16fe2133a9b8" gracePeriod=30
Jul 26 15:36:07.927328 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:07.927292    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"]
Jul 26 15:36:07.927746 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:07.927558    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn" podUID="de4181a7-cb97-441f-b576-f2365cdbbe4d" containerName="payload-processing" containerID="cri-o://69eb8da53b0225437ed8949144c2e38dd8bfce74dc0c56ec7c920edcffd769be" gracePeriod=30
Jul 26 15:36:08.178120 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.178092    2580 generic.go:356] "Generic (PLEG): container finished" podID="19fa0203-3370-4725-8914-3afe43a03145" containerID="99e3f7f6d6aa6c3af02b4eab6dbcd38588e166bc85a87d4d253e16fe2133a9b8" exitCode=0
Jul 26 15:36:08.178256 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.178168    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr" event={"ID":"19fa0203-3370-4725-8914-3afe43a03145","Type":"ContainerDied","Data":"99e3f7f6d6aa6c3af02b4eab6dbcd38588e166bc85a87d4d253e16fe2133a9b8"}
Jul 26 15:36:08.178256 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.178239    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr" event={"ID":"19fa0203-3370-4725-8914-3afe43a03145","Type":"ContainerDied","Data":"eba9d4583fccad6380cc77e32f5893f35f4960757bc702968daee8fec9fe1a6a"}
Jul 26 15:36:08.178372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.178264    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eba9d4583fccad6380cc77e32f5893f35f4960757bc702968daee8fec9fe1a6a"
Jul 26 15:36:08.179587 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.179567    2580 generic.go:356] "Generic (PLEG): container finished" podID="de4181a7-cb97-441f-b576-f2365cdbbe4d" containerID="69eb8da53b0225437ed8949144c2e38dd8bfce74dc0c56ec7c920edcffd769be" exitCode=0
Jul 26 15:36:08.179692 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.179623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn" event={"ID":"de4181a7-cb97-441f-b576-f2365cdbbe4d","Type":"ContainerDied","Data":"69eb8da53b0225437ed8949144c2e38dd8bfce74dc0c56ec7c920edcffd769be"}
Jul 26 15:36:08.187178 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.187162    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:36:08.211163 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.211142    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:36:08.307801 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.307771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls\") pod \"19fa0203-3370-4725-8914-3afe43a03145\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") "
Jul 26 15:36:08.307987 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.307844    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g45td\" (UniqueName: \"kubernetes.io/projected/19fa0203-3370-4725-8914-3afe43a03145-kube-api-access-g45td\") pod \"19fa0203-3370-4725-8914-3afe43a03145\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") "
Jul 26 15:36:08.307987 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.307947    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc6dj\" (UniqueName: \"kubernetes.io/projected/de4181a7-cb97-441f-b576-f2365cdbbe4d-kube-api-access-bc6dj\") pod \"de4181a7-cb97-441f-b576-f2365cdbbe4d\" (UID: \"de4181a7-cb97-441f-b576-f2365cdbbe4d\") "
Jul 26 15:36:08.308119 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.308025    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4181a7-cb97-441f-b576-f2365cdbbe4d-plugins-config-volume\") pod \"de4181a7-cb97-441f-b576-f2365cdbbe4d\" (UID: \"de4181a7-cb97-441f-b576-f2365cdbbe4d\") "
Jul 26 15:36:08.308119 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.308069    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fa0203-3370-4725-8914-3afe43a03145-openshift-service-ca\") pod \"19fa0203-3370-4725-8914-3afe43a03145\" (UID: \"19fa0203-3370-4725-8914-3afe43a03145\") "
Jul 26 15:36:08.308425 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.308397    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4181a7-cb97-441f-b576-f2365cdbbe4d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de4181a7-cb97-441f-b576-f2365cdbbe4d" (UID: "de4181a7-cb97-441f-b576-f2365cdbbe4d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:36:08.308558 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.308449    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19fa0203-3370-4725-8914-3afe43a03145-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "19fa0203-3370-4725-8914-3afe43a03145" (UID: "19fa0203-3370-4725-8914-3afe43a03145"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:36:08.310109 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.310083    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "19fa0203-3370-4725-8914-3afe43a03145" (UID: "19fa0203-3370-4725-8914-3afe43a03145"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:36:08.310206 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.310157    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19fa0203-3370-4725-8914-3afe43a03145-kube-api-access-g45td" (OuterVolumeSpecName: "kube-api-access-g45td") pod "19fa0203-3370-4725-8914-3afe43a03145" (UID: "19fa0203-3370-4725-8914-3afe43a03145"). InnerVolumeSpecName "kube-api-access-g45td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:36:08.310206 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.310182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de4181a7-cb97-441f-b576-f2365cdbbe4d-kube-api-access-bc6dj" (OuterVolumeSpecName: "kube-api-access-bc6dj") pod "de4181a7-cb97-441f-b576-f2365cdbbe4d" (UID: "de4181a7-cb97-441f-b576-f2365cdbbe4d"). InnerVolumeSpecName "kube-api-access-bc6dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:36:08.409415 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.409343    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g45td\" (UniqueName: \"kubernetes.io/projected/19fa0203-3370-4725-8914-3afe43a03145-kube-api-access-g45td\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:36:08.409415 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.409369    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc6dj\" (UniqueName: \"kubernetes.io/projected/de4181a7-cb97-441f-b576-f2365cdbbe4d-kube-api-access-bc6dj\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:36:08.409415 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.409382    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de4181a7-cb97-441f-b576-f2365cdbbe4d-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:36:08.409415 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.409391    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fa0203-3370-4725-8914-3afe43a03145-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:36:08.409415 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:08.409400    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fa0203-3370-4725-8914-3afe43a03145-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:36:09.184638 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:09.184617    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"
Jul 26 15:36:09.185016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:09.184655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn" event={"ID":"de4181a7-cb97-441f-b576-f2365cdbbe4d","Type":"ContainerDied","Data":"99112408861a3eca69e0809d9e2e13d7f10d3bd5769b4076daed490526ffb7c7"}
Jul 26 15:36:09.185016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:09.184709    2580 scope.go:117] "RemoveContainer" containerID="69eb8da53b0225437ed8949144c2e38dd8bfce74dc0c56ec7c920edcffd769be"
Jul 26 15:36:09.185016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:09.184773    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"
Jul 26 15:36:09.201178 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:09.201154    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"]
Jul 26 15:36:09.203013 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:09.202994    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-50ce075b-5d967fc846-fv6vn"]
Jul 26 15:36:09.212670 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:09.212646    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"]
Jul 26 15:36:09.216022 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:09.216001    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50ce075b-6b9774db6f-k8jfr"]
Jul 26 15:36:11.160196 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:11.160162    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19fa0203-3370-4725-8914-3afe43a03145" path="/var/lib/kubelet/pods/19fa0203-3370-4725-8914-3afe43a03145/volumes"
Jul 26 15:36:11.160649 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:11.160634    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de4181a7-cb97-441f-b576-f2365cdbbe4d" path="/var/lib/kubelet/pods/de4181a7-cb97-441f-b576-f2365cdbbe4d/volumes"
Jul 26 15:36:13.699271 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.699239    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"]
Jul 26 15:36:13.699718 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.699636    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19fa0203-3370-4725-8914-3afe43a03145" containerName="maas-api"
Jul 26 15:36:13.699718 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.699649    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19fa0203-3370-4725-8914-3afe43a03145" containerName="maas-api"
Jul 26 15:36:13.699718 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.699666    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4181a7-cb97-441f-b576-f2365cdbbe4d" containerName="payload-processing"
Jul 26 15:36:13.699718 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.699674    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4181a7-cb97-441f-b576-f2365cdbbe4d" containerName="payload-processing"
Jul 26 15:36:13.699927 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.699750    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4181a7-cb97-441f-b576-f2365cdbbe4d" containerName="payload-processing"
Jul 26 15:36:13.699927 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.699764    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19fa0203-3370-4725-8914-3afe43a03145" containerName="maas-api"
Jul 26 15:36:13.704255 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.704237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.708158 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.708134    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-701ef13d-gw-openshift-default-dockercfg-p74ms\""
Jul 26 15:36:13.722935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.722912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"]
Jul 26 15:36:13.757093 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-credential-socket\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.757241 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-socket\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.757241 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d898484d-6ae5-457f-b074-3fec16031783-istio-podinfo\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.757241 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-istio-token\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.757241 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d898484d-6ae5-457f-b074-3fec16031783-istiod-ca-cert\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.757241 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-data\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.757513 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dw6m\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-kube-api-access-5dw6m\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.757513 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-envoy\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.757513 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.757306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-certs\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858073 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-data\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858073 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dw6m\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-kube-api-access-5dw6m\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858284 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-envoy\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858284 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-certs\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858284 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-credential-socket\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858413 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-socket\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858413 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d898484d-6ae5-457f-b074-3fec16031783-istio-podinfo\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858413 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-istio-token\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858413 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d898484d-6ae5-457f-b074-3fec16031783-istiod-ca-cert\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.858613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.858478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-data\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.859070 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.859017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-socket\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.859070 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.859029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-certs\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.859268 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.859226    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-credential-socket\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.859328 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.859289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d898484d-6ae5-457f-b074-3fec16031783-istiod-ca-cert\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.860621 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.860600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-envoy\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.860914 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.860876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d898484d-6ae5-457f-b074-3fec16031783-istio-podinfo\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.869715 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.869693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dw6m\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-kube-api-access-5dw6m\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:13.869857 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:13.869834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-istio-token\") pod \"e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") " pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:14.014647 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:14.014559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:14.152701 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:14.152676    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"]
Jul 26 15:36:14.154471 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:36:14.154443    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd898484d_6ae5_457f_b074_3fec16031783.slice/crio-f37b847f9eba1adcd017335d454a8b2d35177a2dca25e5308398c66f5bc8c04e WatchSource:0}: Error finding container f37b847f9eba1adcd017335d454a8b2d35177a2dca25e5308398c66f5bc8c04e: Status 404 returned error can't find the container with id f37b847f9eba1adcd017335d454a8b2d35177a2dca25e5308398c66f5bc8c04e
Jul 26 15:36:14.156494 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:14.156462    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:36:14.156564 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:14.156526    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:36:14.156564 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:14.156557    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:36:14.210372 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:14.210256    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" event={"ID":"d898484d-6ae5-457f-b074-3fec16031783","Type":"ContainerStarted","Data":"f37b847f9eba1adcd017335d454a8b2d35177a2dca25e5308398c66f5bc8c04e"}
Jul 26 15:36:15.215332 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:15.215297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" event={"ID":"d898484d-6ae5-457f-b074-3fec16031783","Type":"ContainerStarted","Data":"4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e"}
Jul 26 15:36:15.237015 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:15.236956    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" podStartSLOduration=2.236938522 podStartE2EDuration="2.236938522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:36:15.235007583 +0000 UTC m=+1864.608057362" watchObservedRunningTime="2026-07-26 15:36:15.236938522 +0000 UTC m=+1864.609988300"
Jul 26 15:36:16.015333 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.015296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:16.019990 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.019966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:16.220276 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.220246    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:16.221035 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.221018    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:16.780848 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.780813    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"]
Jul 26 15:36:16.784487 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.784467    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.787229 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.787206    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-701ef13d-serving-cert\""
Jul 26 15:36:16.794707 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.794682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"]
Jul 26 15:36:16.883646 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.883619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82ca50d-36cf-4138-92bc-be2d1f59082b-openshift-service-ca\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.883804 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.883653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfqlb\" (UniqueName: \"kubernetes.io/projected/b82ca50d-36cf-4138-92bc-be2d1f59082b-kube-api-access-cfqlb\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.883804 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.883741    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82ca50d-36cf-4138-92bc-be2d1f59082b-maas-api-tls\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.984597 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.984558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82ca50d-36cf-4138-92bc-be2d1f59082b-maas-api-tls\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.984751 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.984616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82ca50d-36cf-4138-92bc-be2d1f59082b-openshift-service-ca\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.984751 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.984635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfqlb\" (UniqueName: \"kubernetes.io/projected/b82ca50d-36cf-4138-92bc-be2d1f59082b-kube-api-access-cfqlb\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.985330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.985306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82ca50d-36cf-4138-92bc-be2d1f59082b-openshift-service-ca\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.986979 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.986960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82ca50d-36cf-4138-92bc-be2d1f59082b-maas-api-tls\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:16.992615 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:16.992597    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfqlb\" (UniqueName: \"kubernetes.io/projected/b82ca50d-36cf-4138-92bc-be2d1f59082b-kube-api-access-cfqlb\") pod \"maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:17.096271 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:17.096190    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:17.231571 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:17.231549    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"]
Jul 26 15:36:17.233096 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:36:17.233067    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82ca50d_36cf_4138_92bc_be2d1f59082b.slice/crio-fe3fdb173ab278127db3b9c5c23774d260c1fcef78f7b490eccc504c504177df WatchSource:0}: Error finding container fe3fdb173ab278127db3b9c5c23774d260c1fcef78f7b490eccc504c504177df: Status 404 returned error can't find the container with id fe3fdb173ab278127db3b9c5c23774d260c1fcef78f7b490eccc504c504177df
Jul 26 15:36:18.230516 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:18.230473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k" event={"ID":"b82ca50d-36cf-4138-92bc-be2d1f59082b","Type":"ContainerStarted","Data":"76824bce858ec7f350c738f80b807486445bed84affe0e08d476f95a28718253"}
Jul 26 15:36:18.230683 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:18.230620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:18.230683 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:18.230651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k" event={"ID":"b82ca50d-36cf-4138-92bc-be2d1f59082b","Type":"ContainerStarted","Data":"fe3fdb173ab278127db3b9c5c23774d260c1fcef78f7b490eccc504c504177df"}
Jul 26 15:36:18.247488 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:18.247437    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k" podStartSLOduration=1.885783236 podStartE2EDuration="2.247424495s" totalImagesPullingTime="361.641259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:36:18.246437446 +0000 UTC m=+1867.619487226" watchObservedRunningTime="2026-07-26 15:36:18.247424495 +0000 UTC m=+1867.620474274"
Jul 26 15:36:24.242693 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:24.242658    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:31.221663 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:31.221623    2580 patch_prober.go:28] interesting pod/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 26 15:36:31.222115 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:31.221712    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 26 15:36:31.292503 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:31.292473    2580 generic.go:356] "Generic (PLEG): container finished" podID="d898484d-6ae5-457f-b074-3fec16031783" containerID="4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e" exitCode=0
Jul 26 15:36:31.292674 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:31.292549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" event={"ID":"d898484d-6ae5-457f-b074-3fec16031783","Type":"ContainerDied","Data":"4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e"}
Jul 26 15:36:31.292986 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:31.292969    2580 scope.go:117] "RemoveContainer" containerID="4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e"
Jul 26 15:36:31.293980 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:31.293947    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:36:31.294052 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:31.294019    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:36:31.294100 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:31.294051    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:36:32.298706 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:32.298665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" event={"ID":"d898484d-6ae5-457f-b074-3fec16031783","Type":"ContainerStarted","Data":"8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397"}
Jul 26 15:36:33.015107 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:33.015057    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:33.015490 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:33.015459    2580 patch_prober.go:28] interesting pod/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 26 15:36:33.015718 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:33.015692    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 26 15:36:34.015670 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:34.015625    2580 patch_prober.go:28] interesting pod/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 26 15:36:34.016337 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:34.016296    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 26 15:36:35.015645 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:35.015590    2580 patch_prober.go:28] interesting pod/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 26 15:36:35.015861 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:35.015687    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 26 15:36:36.016134 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:36.016094    2580 patch_prober.go:28] interesting pod/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 26 15:36:36.016737 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:36.016700    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 26 15:36:37.019452 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:37.019420    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:37.019825 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:37.019680    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:37.020345 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:37.020326    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:36:52.249648 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.249612    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"]
Jul 26 15:36:52.250337 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.249820    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k" podUID="b82ca50d-36cf-4138-92bc-be2d1f59082b" containerName="maas-api" containerID="cri-o://76824bce858ec7f350c738f80b807486445bed84affe0e08d476f95a28718253" gracePeriod=30
Jul 26 15:36:52.396369 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.396333    2580 generic.go:356] "Generic (PLEG): container finished" podID="b82ca50d-36cf-4138-92bc-be2d1f59082b" containerID="76824bce858ec7f350c738f80b807486445bed84affe0e08d476f95a28718253" exitCode=0
Jul 26 15:36:52.396541 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.396397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k" event={"ID":"b82ca50d-36cf-4138-92bc-be2d1f59082b","Type":"ContainerDied","Data":"76824bce858ec7f350c738f80b807486445bed84affe0e08d476f95a28718253"}
Jul 26 15:36:52.516664 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.516643    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:52.631674 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.631635    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82ca50d-36cf-4138-92bc-be2d1f59082b-maas-api-tls\") pod \"b82ca50d-36cf-4138-92bc-be2d1f59082b\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") "
Jul 26 15:36:52.631853 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.631748    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfqlb\" (UniqueName: \"kubernetes.io/projected/b82ca50d-36cf-4138-92bc-be2d1f59082b-kube-api-access-cfqlb\") pod \"b82ca50d-36cf-4138-92bc-be2d1f59082b\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") "
Jul 26 15:36:52.631853 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.631841    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82ca50d-36cf-4138-92bc-be2d1f59082b-openshift-service-ca\") pod \"b82ca50d-36cf-4138-92bc-be2d1f59082b\" (UID: \"b82ca50d-36cf-4138-92bc-be2d1f59082b\") "
Jul 26 15:36:52.632220 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.632190    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82ca50d-36cf-4138-92bc-be2d1f59082b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b82ca50d-36cf-4138-92bc-be2d1f59082b" (UID: "b82ca50d-36cf-4138-92bc-be2d1f59082b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:36:52.634284 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.634261    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82ca50d-36cf-4138-92bc-be2d1f59082b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b82ca50d-36cf-4138-92bc-be2d1f59082b" (UID: "b82ca50d-36cf-4138-92bc-be2d1f59082b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:36:52.634284 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.634268    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82ca50d-36cf-4138-92bc-be2d1f59082b-kube-api-access-cfqlb" (OuterVolumeSpecName: "kube-api-access-cfqlb") pod "b82ca50d-36cf-4138-92bc-be2d1f59082b" (UID: "b82ca50d-36cf-4138-92bc-be2d1f59082b"). InnerVolumeSpecName "kube-api-access-cfqlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:36:52.732821 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.732783    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfqlb\" (UniqueName: \"kubernetes.io/projected/b82ca50d-36cf-4138-92bc-be2d1f59082b-kube-api-access-cfqlb\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:36:52.732821 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.732814    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b82ca50d-36cf-4138-92bc-be2d1f59082b-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:36:52.732821 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:52.732825    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b82ca50d-36cf-4138-92bc-be2d1f59082b-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:36:53.401761 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:53.401733    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"
Jul 26 15:36:53.402266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:53.401732    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k" event={"ID":"b82ca50d-36cf-4138-92bc-be2d1f59082b","Type":"ContainerDied","Data":"fe3fdb173ab278127db3b9c5c23774d260c1fcef78f7b490eccc504c504177df"}
Jul 26 15:36:53.402266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:53.401873    2580 scope.go:117] "RemoveContainer" containerID="76824bce858ec7f350c738f80b807486445bed84affe0e08d476f95a28718253"
Jul 26 15:36:53.418826 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:53.418800    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"]
Jul 26 15:36:53.422220 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:53.422165    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-701ef13d-7b8d894786-4nn7k"]
Jul 26 15:36:55.159779 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:55.159738    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82ca50d-36cf-4138-92bc-be2d1f59082b" path="/var/lib/kubelet/pods/b82ca50d-36cf-4138-92bc-be2d1f59082b/volumes"
Jul 26 15:36:56.882071 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:56.882038    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"]
Jul 26 15:36:56.882528 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:36:56.882317    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy" containerID="cri-o://8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397" gracePeriod=30
Jul 26 15:37:00.529444 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.529402    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"]
Jul 26 15:37:00.529849 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.529814    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82ca50d-36cf-4138-92bc-be2d1f59082b" containerName="maas-api"
Jul 26 15:37:00.529849 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.529827    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82ca50d-36cf-4138-92bc-be2d1f59082b" containerName="maas-api"
Jul 26 15:37:00.529962 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.529903    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82ca50d-36cf-4138-92bc-be2d1f59082b" containerName="maas-api"
Jul 26 15:37:00.534048 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.534029    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:00.542437 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.542410    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-340f592c-serving-cert\""
Jul 26 15:37:00.547039 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.547012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"]
Jul 26 15:37:00.601053 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.601011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-openshift-service-ca\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:00.601215 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.601132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:00.601215 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.601163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ck6x\" (UniqueName: \"kubernetes.io/projected/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-kube-api-access-7ck6x\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:00.701960 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.701924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-openshift-service-ca\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:00.702170 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.702010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:00.702170 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:37:00.702102    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-serving-cert: secret "maas-api-e2e-ait-340f592c-serving-cert" not found
Jul 26 15:37:00.702170 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.702116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ck6x\" (UniqueName: \"kubernetes.io/projected/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-kube-api-access-7ck6x\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:00.702331 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:37:00.702177    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls podName:fc2d86b8-4f4f-403c-b4ef-33d5c14034e7 nodeName:}" failed. No retries permitted until 2026-07-26 15:37:01.20214582 +0000 UTC m=+1910.575195583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls") pod "maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74" (UID: "fc2d86b8-4f4f-403c-b4ef-33d5c14034e7") : secret "maas-api-e2e-ait-340f592c-serving-cert" not found
Jul 26 15:37:00.702683 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.702663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-openshift-service-ca\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:00.711267 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:00.711234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ck6x\" (UniqueName: \"kubernetes.io/projected/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-kube-api-access-7ck6x\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:01.206716 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:01.206678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:01.209225 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:01.209199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls\") pod \"maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:01.455199 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:01.455164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:01.593370 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:01.593342    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"]
Jul 26 15:37:01.595846 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:37:01.595804    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2d86b8_4f4f_403c_b4ef_33d5c14034e7.slice/crio-e7070f25250026a295f1f89ec7b0a67fd9fb57d02cb40a5c750c23556deb7c1c WatchSource:0}: Error finding container e7070f25250026a295f1f89ec7b0a67fd9fb57d02cb40a5c750c23556deb7c1c: Status 404 returned error can't find the container with id e7070f25250026a295f1f89ec7b0a67fd9fb57d02cb40a5c750c23556deb7c1c
Jul 26 15:37:02.140705 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.140675    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:37:02.215742 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.215644    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d898484d-6ae5-457f-b074-3fec16031783-istiod-ca-cert\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.215742 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.215685    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dw6m\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-kube-api-access-5dw6m\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.215742 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.215718    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d898484d-6ae5-457f-b074-3fec16031783-istio-podinfo\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.216080 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.215811    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-istio-token\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.216080 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.215846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-envoy\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.216226 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.215882    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-data\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.216378 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216280    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-certs\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.216378 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216091    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d898484d-6ae5-457f-b074-3fec16031783-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:37:02.216378 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-credential-socket\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.216378 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216349    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-socket\") pod \"d898484d-6ae5-457f-b074-3fec16031783\" (UID: \"d898484d-6ae5-457f-b074-3fec16031783\") "
Jul 26 15:37:02.216704 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216656    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d898484d-6ae5-457f-b074-3fec16031783-istiod-ca-cert\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.216704 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216649    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:37:02.216704 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216660    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:37:02.216869 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-data" (OuterVolumeSpecName: "istio-data") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:37:02.216869 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.216831    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:37:02.218218 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.218197    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-istio-token" (OuterVolumeSpecName: "istio-token") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:37:02.218415 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.218385    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:37:02.218488 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.218421    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-kube-api-access-5dw6m" (OuterVolumeSpecName: "kube-api-access-5dw6m") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "kube-api-access-5dw6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:37:02.218656 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.218632    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d898484d-6ae5-457f-b074-3fec16031783-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d898484d-6ae5-457f-b074-3fec16031783" (UID: "d898484d-6ae5-457f-b074-3fec16031783"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 15:37:02.317328 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.317284    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-istio-token\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.317328 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.317317    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-envoy\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.317328 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.317328    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-istio-data\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.317328 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.317336    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-certs\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.317595 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.317345    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-credential-socket\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.317595 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.317356    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d898484d-6ae5-457f-b074-3fec16031783-workload-socket\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.317595 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.317365    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dw6m\" (UniqueName: \"kubernetes.io/projected/d898484d-6ae5-457f-b074-3fec16031783-kube-api-access-5dw6m\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.317595 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.317374    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d898484d-6ae5-457f-b074-3fec16031783-istio-podinfo\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:02.445688 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.445653    2580 generic.go:356] "Generic (PLEG): container finished" podID="d898484d-6ae5-457f-b074-3fec16031783" containerID="8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397" exitCode=0
Jul 26 15:37:02.445882 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.445705    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"
Jul 26 15:37:02.445882 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.445728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" event={"ID":"d898484d-6ae5-457f-b074-3fec16031783","Type":"ContainerDied","Data":"8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397"}
Jul 26 15:37:02.445882 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.445775    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh" event={"ID":"d898484d-6ae5-457f-b074-3fec16031783","Type":"ContainerDied","Data":"f37b847f9eba1adcd017335d454a8b2d35177a2dca25e5308398c66f5bc8c04e"}
Jul 26 15:37:02.445882 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.445797    2580 scope.go:117] "RemoveContainer" containerID="8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397"
Jul 26 15:37:02.447356 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.447330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74" event={"ID":"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7","Type":"ContainerStarted","Data":"261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76"}
Jul 26 15:37:02.447482 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.447380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74" event={"ID":"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7","Type":"ContainerStarted","Data":"e7070f25250026a295f1f89ec7b0a67fd9fb57d02cb40a5c750c23556deb7c1c"}
Jul 26 15:37:02.447482 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.447425    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:02.454995 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.454978    2580 scope.go:117] "RemoveContainer" containerID="4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e"
Jul 26 15:37:02.463035 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.462836    2580 scope.go:117] "RemoveContainer" containerID="8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397"
Jul 26 15:37:02.463174 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:37:02.463156    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397\": container with ID starting with 8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397 not found: ID does not exist" containerID="8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397"
Jul 26 15:37:02.463212 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.463183    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397"} err="failed to get container status \"8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397\": rpc error: code = NotFound desc = could not find container \"8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397\": container with ID starting with 8832a56dfcd1412e29e6105ad33565a9f1e2fc0a83c371f14e2c726a1b108397 not found: ID does not exist"
Jul 26 15:37:02.463212 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.463202    2580 scope.go:117] "RemoveContainer" containerID="4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e"
Jul 26 15:37:02.463418 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:37:02.463384    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e\": container with ID starting with 4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e not found: ID does not exist" containerID="4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e"
Jul 26 15:37:02.463467 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.463411    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e"} err="failed to get container status \"4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e\": rpc error: code = NotFound desc = could not find container \"4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e\": container with ID starting with 4151e20f61eb0cdcefb1bbd36a8f9a506bfeb0ca146ab76ccc5b2ee1975de11e not found: ID does not exist"
Jul 26 15:37:02.466127 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.466060    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74" podStartSLOduration=2.104280087 podStartE2EDuration="2.466047159s" totalImagesPullingTime="361.767072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:37:02.4639748 +0000 UTC m=+1911.837024579" watchObservedRunningTime="2026-07-26 15:37:02.466047159 +0000 UTC m=+1911.839096939"
Jul 26 15:37:02.477833 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.477809    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"]
Jul 26 15:37:02.482011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:02.481984    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-701ef13d-gw-openshift-default-7dbb4df4dd-4dqbh"]
Jul 26 15:37:03.160697 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:03.160664    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d898484d-6ae5-457f-b074-3fec16031783" path="/var/lib/kubelet/pods/d898484d-6ae5-457f-b074-3fec16031783/volumes"
Jul 26 15:37:08.458244 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:08.458217    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:26.216576 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.216536    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"]
Jul 26 15:37:26.217124 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.216968    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy"
Jul 26 15:37:26.217124 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.216981    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy"
Jul 26 15:37:26.217124 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.216992    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy"
Jul 26 15:37:26.217124 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.216998    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy"
Jul 26 15:37:26.217124 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.217074    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy"
Jul 26 15:37:26.217124 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.217081    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d898484d-6ae5-457f-b074-3fec16031783" containerName="istio-proxy"
Jul 26 15:37:26.220289 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.220271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"
Jul 26 15:37:26.223043 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.223021    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d665x\""
Jul 26 15:37:26.227148 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.227109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"]
Jul 26 15:37:26.338571 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.338533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beee72bd-1c20-4c03-96ed-b33dc9c28173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-340f592c-5r6w7\" (UID: \"beee72bd-1c20-4c03-96ed-b33dc9c28173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"
Jul 26 15:37:26.439560 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.439521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beee72bd-1c20-4c03-96ed-b33dc9c28173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-340f592c-5r6w7\" (UID: \"beee72bd-1c20-4c03-96ed-b33dc9c28173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"
Jul 26 15:37:26.440240 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.440214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beee72bd-1c20-4c03-96ed-b33dc9c28173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-340f592c-5r6w7\" (UID: \"beee72bd-1c20-4c03-96ed-b33dc9c28173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"
Jul 26 15:37:26.532445 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.532413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"
Jul 26 15:37:26.683731 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:26.683694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"]
Jul 26 15:37:26.684654 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:37:26.684623    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeee72bd_1c20_4c03_96ed_b33dc9c28173.slice/crio-2f3000eb944031a5225e0a677e5f8c54a641f7f7c1945869bac4ab9efa509c87 WatchSource:0}: Error finding container 2f3000eb944031a5225e0a677e5f8c54a641f7f7c1945869bac4ab9efa509c87: Status 404 returned error can't find the container with id 2f3000eb944031a5225e0a677e5f8c54a641f7f7c1945869bac4ab9efa509c87
Jul 26 15:37:27.570751 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:27.570709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7" event={"ID":"beee72bd-1c20-4c03-96ed-b33dc9c28173","Type":"ContainerStarted","Data":"2f3000eb944031a5225e0a677e5f8c54a641f7f7c1945869bac4ab9efa509c87"}
Jul 26 15:37:29.581534 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:29.581495    2580 generic.go:356] "Generic (PLEG): container finished" podID="beee72bd-1c20-4c03-96ed-b33dc9c28173" containerID="b2746edb543358d3e821e14c119b242ef8f6d8d923ec0d240bee530af898fb81" exitCode=0
Jul 26 15:37:29.581975 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:29.581572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7" event={"ID":"beee72bd-1c20-4c03-96ed-b33dc9c28173","Type":"ContainerDied","Data":"b2746edb543358d3e821e14c119b242ef8f6d8d923ec0d240bee530af898fb81"}
Jul 26 15:37:30.720050 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:30.720023    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"
Jul 26 15:37:30.885210 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:30.885123    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beee72bd-1c20-4c03-96ed-b33dc9c28173-maas-api-service-ca\") pod \"beee72bd-1c20-4c03-96ed-b33dc9c28173\" (UID: \"beee72bd-1c20-4c03-96ed-b33dc9c28173\") "
Jul 26 15:37:30.885583 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:30.885555    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beee72bd-1c20-4c03-96ed-b33dc9c28173-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "beee72bd-1c20-4c03-96ed-b33dc9c28173" (UID: "beee72bd-1c20-4c03-96ed-b33dc9c28173"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:37:30.986633 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:30.986598    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/beee72bd-1c20-4c03-96ed-b33dc9c28173-maas-api-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:31.591660 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:31.591620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7" event={"ID":"beee72bd-1c20-4c03-96ed-b33dc9c28173","Type":"ContainerDied","Data":"2f3000eb944031a5225e0a677e5f8c54a641f7f7c1945869bac4ab9efa509c87"}
Jul 26 15:37:31.591834 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:31.591701    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f3000eb944031a5225e0a677e5f8c54a641f7f7c1945869bac4ab9efa509c87"
Jul 26 15:37:31.591834 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:31.591637    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"
Jul 26 15:37:36.709547 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:36.709512    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"]
Jul 26 15:37:36.709992 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:36.709761    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74" podUID="fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" containerName="maas-api" containerID="cri-o://261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76" gracePeriod=30
Jul 26 15:37:36.960388 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:36.960335    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:37.144080 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.144047    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ck6x\" (UniqueName: \"kubernetes.io/projected/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-kube-api-access-7ck6x\") pod \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") "
Jul 26 15:37:37.144080 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.144086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls\") pod \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") "
Jul 26 15:37:37.144285 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.144193    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-openshift-service-ca\") pod \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\" (UID: \"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7\") "
Jul 26 15:37:37.144570 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.144538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" (UID: "fc2d86b8-4f4f-403c-b4ef-33d5c14034e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:37:37.146194 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.146165    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-kube-api-access-7ck6x" (OuterVolumeSpecName: "kube-api-access-7ck6x") pod "fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" (UID: "fc2d86b8-4f4f-403c-b4ef-33d5c14034e7"). InnerVolumeSpecName "kube-api-access-7ck6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:37:37.146278 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.146208    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" (UID: "fc2d86b8-4f4f-403c-b4ef-33d5c14034e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:37:37.245340 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.245271    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:37.245340 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.245298    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ck6x\" (UniqueName: \"kubernetes.io/projected/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-kube-api-access-7ck6x\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:37.245340 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.245308    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:37:37.619861 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.619829    2580 generic.go:356] "Generic (PLEG): container finished" podID="fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" containerID="261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76" exitCode=0
Jul 26 15:37:37.620028 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.619901    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"
Jul 26 15:37:37.620028 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.619924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74" event={"ID":"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7","Type":"ContainerDied","Data":"261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76"}
Jul 26 15:37:37.620028 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.619996    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74" event={"ID":"fc2d86b8-4f4f-403c-b4ef-33d5c14034e7","Type":"ContainerDied","Data":"e7070f25250026a295f1f89ec7b0a67fd9fb57d02cb40a5c750c23556deb7c1c"}
Jul 26 15:37:37.620028 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.620018    2580 scope.go:117] "RemoveContainer" containerID="261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76"
Jul 26 15:37:37.628856 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.628837    2580 scope.go:117] "RemoveContainer" containerID="261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76"
Jul 26 15:37:37.629116 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:37:37.629097    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76\": container with ID starting with 261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76 not found: ID does not exist" containerID="261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76"
Jul 26 15:37:37.629166 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.629124    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76"} err="failed to get container status \"261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76\": rpc error: code = NotFound desc = could not find container \"261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76\": container with ID starting with 261cf411b3640c9f62cd98ad8502656597fa3310e51dc4b13e092068636cea76 not found: ID does not exist"
Jul 26 15:37:37.636753 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.636732    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"]
Jul 26 15:37:37.640059 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:37.640037    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-340f592c-684cf4cf5d-jfd74"]
Jul 26 15:37:39.161805 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:39.161768    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" path="/var/lib/kubelet/pods/fc2d86b8-4f4f-403c-b4ef-33d5c14034e7/volumes"
Jul 26 15:37:41.296794 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:41.296762    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"]
Jul 26 15:37:41.299976 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:41.299945    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-340f592c-5r6w7"]
Jul 26 15:37:43.159575 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:43.159539    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beee72bd-1c20-4c03-96ed-b33dc9c28173" path="/var/lib/kubelet/pods/beee72bd-1c20-4c03-96ed-b33dc9c28173/volumes"
Jul 26 15:37:45.802390 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.802356    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"]
Jul 26 15:37:45.802934 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.802915    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" containerName="maas-api"
Jul 26 15:37:45.803016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.802936    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" containerName="maas-api"
Jul 26 15:37:45.803016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.802959    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beee72bd-1c20-4c03-96ed-b33dc9c28173" containerName="revoke-keys"
Jul 26 15:37:45.803016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.802969    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="beee72bd-1c20-4c03-96ed-b33dc9c28173" containerName="revoke-keys"
Jul 26 15:37:45.803171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.803068    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="beee72bd-1c20-4c03-96ed-b33dc9c28173" containerName="revoke-keys"
Jul 26 15:37:45.803171 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.803084    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2d86b8-4f4f-403c-b4ef-33d5c14034e7" containerName="maas-api"
Jul 26 15:37:45.806219 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.806198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:45.808991 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.808969    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ae91a44a-serving-cert\""
Jul 26 15:37:45.816355 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.816330    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"]
Jul 26 15:37:45.920083 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.920049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb25k\" (UniqueName: \"kubernetes.io/projected/cebef9f0-3b45-455b-8817-f0d876aa70c7-kube-api-access-jb25k\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:45.920402 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.920378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:45.920545 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:45.920529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cebef9f0-3b45-455b-8817-f0d876aa70c7-openshift-service-ca\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.022205 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.022162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.022205 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.022219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cebef9f0-3b45-455b-8817-f0d876aa70c7-openshift-service-ca\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.022421 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.022289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb25k\" (UniqueName: \"kubernetes.io/projected/cebef9f0-3b45-455b-8817-f0d876aa70c7-kube-api-access-jb25k\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.022421 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:37:46.022328    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-serving-cert: secret "maas-api-e2e-derive-ae91a44a-serving-cert" not found
Jul 26 15:37:46.022421 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:37:46.022403    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls podName:cebef9f0-3b45-455b-8817-f0d876aa70c7 nodeName:}" failed. No retries permitted until 2026-07-26 15:37:46.522382787 +0000 UTC m=+1955.895432548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls") pod "maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh" (UID: "cebef9f0-3b45-455b-8817-f0d876aa70c7") : secret "maas-api-e2e-derive-ae91a44a-serving-cert" not found
Jul 26 15:37:46.022936 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.022919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cebef9f0-3b45-455b-8817-f0d876aa70c7-openshift-service-ca\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.033346 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.033321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb25k\" (UniqueName: \"kubernetes.io/projected/cebef9f0-3b45-455b-8817-f0d876aa70c7-kube-api-access-jb25k\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.526286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.526248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.528852 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.528822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls\") pod \"maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.717549 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.717512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:46.847923 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:46.847883    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"]
Jul 26 15:37:46.850148 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:37:46.850117    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcebef9f0_3b45_455b_8817_f0d876aa70c7.slice/crio-db4ce6a99074724d4fcc34d55763dcba0cf4c6450bec1c6a6c33a80b688f582d WatchSource:0}: Error finding container db4ce6a99074724d4fcc34d55763dcba0cf4c6450bec1c6a6c33a80b688f582d: Status 404 returned error can't find the container with id db4ce6a99074724d4fcc34d55763dcba0cf4c6450bec1c6a6c33a80b688f582d
Jul 26 15:37:47.670424 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:47.670386    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh" event={"ID":"cebef9f0-3b45-455b-8817-f0d876aa70c7","Type":"ContainerStarted","Data":"ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7"}
Jul 26 15:37:47.670613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:47.670450    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh" event={"ID":"cebef9f0-3b45-455b-8817-f0d876aa70c7","Type":"ContainerStarted","Data":"db4ce6a99074724d4fcc34d55763dcba0cf4c6450bec1c6a6c33a80b688f582d"}
Jul 26 15:37:47.670613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:47.670489    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:37:47.690239 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:47.690173    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh" podStartSLOduration=2.318029574 podStartE2EDuration="2.690157829s" totalImagesPullingTime="372.128255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:37:47.687653872 +0000 UTC m=+1957.060703652" watchObservedRunningTime="2026-07-26 15:37:47.690157829 +0000 UTC m=+1957.063207608"
Jul 26 15:37:53.683327 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:37:53.683299    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:38:10.567688 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:10.567611    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"]
Jul 26 15:38:10.575916 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:10.575862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"
Jul 26 15:38:10.576560 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:10.576538    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"]
Jul 26 15:38:10.578625 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:10.578603    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d665x\""
Jul 26 15:38:10.734354 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:10.734321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa8ac86-c913-4193-a7e1-7bf9dcdedb66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf\" (UID: \"0aa8ac86-c913-4193-a7e1-7bf9dcdedb66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"
Jul 26 15:38:10.835251 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:10.835177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa8ac86-c913-4193-a7e1-7bf9dcdedb66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf\" (UID: \"0aa8ac86-c913-4193-a7e1-7bf9dcdedb66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"
Jul 26 15:38:10.835735 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:10.835717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa8ac86-c913-4193-a7e1-7bf9dcdedb66-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf\" (UID: \"0aa8ac86-c913-4193-a7e1-7bf9dcdedb66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"
Jul 26 15:38:10.886876 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:10.886848    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"
Jul 26 15:38:11.015195 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:11.015168    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"]
Jul 26 15:38:11.017152 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:38:11.017124    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa8ac86_c913_4193_a7e1_7bf9dcdedb66.slice/crio-9efc5f6c6372806243eb0fc48d5fea808af41381a7f56ceb374e7a062fc9b4a1 WatchSource:0}: Error finding container 9efc5f6c6372806243eb0fc48d5fea808af41381a7f56ceb374e7a062fc9b4a1: Status 404 returned error can't find the container with id 9efc5f6c6372806243eb0fc48d5fea808af41381a7f56ceb374e7a062fc9b4a1
Jul 26 15:38:11.789934 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:11.789879    2580 generic.go:356] "Generic (PLEG): container finished" podID="0aa8ac86-c913-4193-a7e1-7bf9dcdedb66" containerID="cd5472a22904a543c520d2fee60e14d24a8223d3f2950ae135cfc3614d6e0aa7" exitCode=0
Jul 26 15:38:11.789934 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:11.789922    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf" event={"ID":"0aa8ac86-c913-4193-a7e1-7bf9dcdedb66","Type":"ContainerDied","Data":"cd5472a22904a543c520d2fee60e14d24a8223d3f2950ae135cfc3614d6e0aa7"}
Jul 26 15:38:11.790341 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:11.789979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf" event={"ID":"0aa8ac86-c913-4193-a7e1-7bf9dcdedb66","Type":"ContainerStarted","Data":"9efc5f6c6372806243eb0fc48d5fea808af41381a7f56ceb374e7a062fc9b4a1"}
Jul 26 15:38:12.923324 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:12.923300    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"
Jul 26 15:38:13.057628 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:13.057537    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa8ac86-c913-4193-a7e1-7bf9dcdedb66-maas-api-service-ca\") pod \"0aa8ac86-c913-4193-a7e1-7bf9dcdedb66\" (UID: \"0aa8ac86-c913-4193-a7e1-7bf9dcdedb66\") "
Jul 26 15:38:13.057937 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:13.057913    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa8ac86-c913-4193-a7e1-7bf9dcdedb66-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0aa8ac86-c913-4193-a7e1-7bf9dcdedb66" (UID: "0aa8ac86-c913-4193-a7e1-7bf9dcdedb66"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:38:13.158638 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:13.158597    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa8ac86-c913-4193-a7e1-7bf9dcdedb66-maas-api-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:38:13.800105 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:13.800073    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"
Jul 26 15:38:13.800279 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:13.800101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf" event={"ID":"0aa8ac86-c913-4193-a7e1-7bf9dcdedb66","Type":"ContainerDied","Data":"9efc5f6c6372806243eb0fc48d5fea808af41381a7f56ceb374e7a062fc9b4a1"}
Jul 26 15:38:13.800279 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:13.800155    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9efc5f6c6372806243eb0fc48d5fea808af41381a7f56ceb374e7a062fc9b4a1"
Jul 26 15:38:21.121402 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.121365    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"]
Jul 26 15:38:21.122046 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.121647    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh" podUID="cebef9f0-3b45-455b-8817-f0d876aa70c7" containerName="maas-api" containerID="cri-o://ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7" gracePeriod=30
Jul 26 15:38:21.375762 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.375703    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:38:21.530330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.530297    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb25k\" (UniqueName: \"kubernetes.io/projected/cebef9f0-3b45-455b-8817-f0d876aa70c7-kube-api-access-jb25k\") pod \"cebef9f0-3b45-455b-8817-f0d876aa70c7\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") "
Jul 26 15:38:21.530330 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.530335    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls\") pod \"cebef9f0-3b45-455b-8817-f0d876aa70c7\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") "
Jul 26 15:38:21.530540 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.530354    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cebef9f0-3b45-455b-8817-f0d876aa70c7-openshift-service-ca\") pod \"cebef9f0-3b45-455b-8817-f0d876aa70c7\" (UID: \"cebef9f0-3b45-455b-8817-f0d876aa70c7\") "
Jul 26 15:38:21.530788 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.530762    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cebef9f0-3b45-455b-8817-f0d876aa70c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cebef9f0-3b45-455b-8817-f0d876aa70c7" (UID: "cebef9f0-3b45-455b-8817-f0d876aa70c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:38:21.532468 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.532433    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cebef9f0-3b45-455b-8817-f0d876aa70c7-kube-api-access-jb25k" (OuterVolumeSpecName: "kube-api-access-jb25k") pod "cebef9f0-3b45-455b-8817-f0d876aa70c7" (UID: "cebef9f0-3b45-455b-8817-f0d876aa70c7"). InnerVolumeSpecName "kube-api-access-jb25k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:38:21.532572 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.532544    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cebef9f0-3b45-455b-8817-f0d876aa70c7" (UID: "cebef9f0-3b45-455b-8817-f0d876aa70c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:38:21.631915 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.631805    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb25k\" (UniqueName: \"kubernetes.io/projected/cebef9f0-3b45-455b-8817-f0d876aa70c7-kube-api-access-jb25k\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:38:21.631915 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.631834    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cebef9f0-3b45-455b-8817-f0d876aa70c7-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:38:21.631915 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.631844    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cebef9f0-3b45-455b-8817-f0d876aa70c7-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:38:21.839693 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.839657    2580 generic.go:356] "Generic (PLEG): container finished" podID="cebef9f0-3b45-455b-8817-f0d876aa70c7" containerID="ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7" exitCode=0
Jul 26 15:38:21.839874 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.839701    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"
Jul 26 15:38:21.839874 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.839739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh" event={"ID":"cebef9f0-3b45-455b-8817-f0d876aa70c7","Type":"ContainerDied","Data":"ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7"}
Jul 26 15:38:21.839874 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.839791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh" event={"ID":"cebef9f0-3b45-455b-8817-f0d876aa70c7","Type":"ContainerDied","Data":"db4ce6a99074724d4fcc34d55763dcba0cf4c6450bec1c6a6c33a80b688f582d"}
Jul 26 15:38:21.839874 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.839814    2580 scope.go:117] "RemoveContainer" containerID="ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7"
Jul 26 15:38:21.849432 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.849414    2580 scope.go:117] "RemoveContainer" containerID="ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7"
Jul 26 15:38:21.849676 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:38:21.849657    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7\": container with ID starting with ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7 not found: ID does not exist" containerID="ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7"
Jul 26 15:38:21.849743 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.849683    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7"} err="failed to get container status \"ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7\": rpc error: code = NotFound desc = could not find container \"ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7\": container with ID starting with ddfe36b385e22f8bdfd64683264accccda901e504587d601a907a86bac3a21f7 not found: ID does not exist"
Jul 26 15:38:21.861204 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.861182    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"]
Jul 26 15:38:21.864712 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:21.864692    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ae91a44a-685dff6945-xwxxh"]
Jul 26 15:38:23.160646 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:23.160607    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cebef9f0-3b45-455b-8817-f0d876aa70c7" path="/var/lib/kubelet/pods/cebef9f0-3b45-455b-8817-f0d876aa70c7/volumes"
Jul 26 15:38:25.641393 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:25.641339    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"]
Jul 26 15:38:25.644031 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:25.644008    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ae91a44a-h68lf"]
Jul 26 15:38:27.164430 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:38:27.164394    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa8ac86-c913-4193-a7e1-7bf9dcdedb66" path="/var/lib/kubelet/pods/0aa8ac86-c913-4193-a7e1-7bf9dcdedb66/volumes"
Jul 26 15:40:06.246756 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.246721    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"]
Jul 26 15:40:06.247286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.247107    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cebef9f0-3b45-455b-8817-f0d876aa70c7" containerName="maas-api"
Jul 26 15:40:06.247286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.247121    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cebef9f0-3b45-455b-8817-f0d876aa70c7" containerName="maas-api"
Jul 26 15:40:06.247286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.247139    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa8ac86-c913-4193-a7e1-7bf9dcdedb66" containerName="revoke-keys"
Jul 26 15:40:06.247286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.247144    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa8ac86-c913-4193-a7e1-7bf9dcdedb66" containerName="revoke-keys"
Jul 26 15:40:06.247286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.247194    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa8ac86-c913-4193-a7e1-7bf9dcdedb66" containerName="revoke-keys"
Jul 26 15:40:06.247286 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.247208    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cebef9f0-3b45-455b-8817-f0d876aa70c7" containerName="maas-api"
Jul 26 15:40:06.250200 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.250184    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.252836 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.252813    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1d5bf042-serving-cert\""
Jul 26 15:40:06.262250 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.262226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"]
Jul 26 15:40:06.368328 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.368294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af749a7-0a3b-4937-bd64-6edf37939d62-openshift-service-ca\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.368517 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.368353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78g49\" (UniqueName: \"kubernetes.io/projected/2af749a7-0a3b-4937-bd64-6edf37939d62-kube-api-access-78g49\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.368517 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.368473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.469844 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.469800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.470030 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.469868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af749a7-0a3b-4937-bd64-6edf37939d62-openshift-service-ca\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.470030 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.469952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78g49\" (UniqueName: \"kubernetes.io/projected/2af749a7-0a3b-4937-bd64-6edf37939d62-kube-api-access-78g49\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.470030 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:40:06.469979    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-serving-cert: secret "maas-api-e2e-mt-1d5bf042-serving-cert" not found
Jul 26 15:40:06.470153 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:40:06.470049    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls podName:2af749a7-0a3b-4937-bd64-6edf37939d62 nodeName:}" failed. No retries permitted until 2026-07-26 15:40:06.970029673 +0000 UTC m=+2096.343079447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls") pod "maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj" (UID: "2af749a7-0a3b-4937-bd64-6edf37939d62") : secret "maas-api-e2e-mt-1d5bf042-serving-cert" not found
Jul 26 15:40:06.470598 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.470579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af749a7-0a3b-4937-bd64-6edf37939d62-openshift-service-ca\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.478606 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.478587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78g49\" (UniqueName: \"kubernetes.io/projected/2af749a7-0a3b-4937-bd64-6edf37939d62-kube-api-access-78g49\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.973665 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.973631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:06.975902 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:06.975867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls\") pod \"maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:07.165254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.165218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:07.185190 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.185162    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"]
Jul 26 15:40:07.188739 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.188721    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:07.192188 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.192168    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1d5bf042\""
Jul 26 15:40:07.193056 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.193031    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1d5bf042-dockercfg-dkfts\""
Jul 26 15:40:07.199974 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.199947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"]
Jul 26 15:40:07.275943 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.275909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32a60f6d-2ca7-4495-aeef-821b7393d5b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn\" (UID: \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:07.276327 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.275991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95q8p\" (UniqueName: \"kubernetes.io/projected/32a60f6d-2ca7-4495-aeef-821b7393d5b1-kube-api-access-95q8p\") pod \"payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn\" (UID: \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:07.313322 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.313291    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"]
Jul 26 15:40:07.316682 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:40:07.316652    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af749a7_0a3b_4937_bd64_6edf37939d62.slice/crio-ce6c53d87813b4386c9d04de797625bfe43044cb5c2b6f8197e8bd3a1203781d WatchSource:0}: Error finding container ce6c53d87813b4386c9d04de797625bfe43044cb5c2b6f8197e8bd3a1203781d: Status 404 returned error can't find the container with id ce6c53d87813b4386c9d04de797625bfe43044cb5c2b6f8197e8bd3a1203781d
Jul 26 15:40:07.340185 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.340158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj" event={"ID":"2af749a7-0a3b-4937-bd64-6edf37939d62","Type":"ContainerStarted","Data":"ce6c53d87813b4386c9d04de797625bfe43044cb5c2b6f8197e8bd3a1203781d"}
Jul 26 15:40:07.377170 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.377142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32a60f6d-2ca7-4495-aeef-821b7393d5b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn\" (UID: \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:07.377303 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.377192    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95q8p\" (UniqueName: \"kubernetes.io/projected/32a60f6d-2ca7-4495-aeef-821b7393d5b1-kube-api-access-95q8p\") pod \"payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn\" (UID: \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:07.377847 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.377822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32a60f6d-2ca7-4495-aeef-821b7393d5b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn\" (UID: \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:07.385849 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.385827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95q8p\" (UniqueName: \"kubernetes.io/projected/32a60f6d-2ca7-4495-aeef-821b7393d5b1-kube-api-access-95q8p\") pod \"payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn\" (UID: \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:07.500314 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.500232    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:07.835759 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:07.835726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"]
Jul 26 15:40:07.842430 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:40:07.842398    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a60f6d_2ca7_4495_aeef_821b7393d5b1.slice/crio-2333959138f01e7ea1a8f41a78fa4843be3628bd3a43665695e6c06b5960129e WatchSource:0}: Error finding container 2333959138f01e7ea1a8f41a78fa4843be3628bd3a43665695e6c06b5960129e: Status 404 returned error can't find the container with id 2333959138f01e7ea1a8f41a78fa4843be3628bd3a43665695e6c06b5960129e
Jul 26 15:40:08.346670 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:08.346632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj" event={"ID":"2af749a7-0a3b-4937-bd64-6edf37939d62","Type":"ContainerStarted","Data":"625d34e0d8d6683e4398c5f0a83e7a769aa62b964e6b97aa14b5a9167bad5237"}
Jul 26 15:40:08.347125 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:08.346792    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:08.348258 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:08.348224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn" event={"ID":"32a60f6d-2ca7-4495-aeef-821b7393d5b1","Type":"ContainerStarted","Data":"58c7e1f8a63a180bd46a5fc2bce095fd0849f949afe6b50110e7b871589fa22d"}
Jul 26 15:40:08.348394 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:08.348267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn" event={"ID":"32a60f6d-2ca7-4495-aeef-821b7393d5b1","Type":"ContainerStarted","Data":"2333959138f01e7ea1a8f41a78fa4843be3628bd3a43665695e6c06b5960129e"}
Jul 26 15:40:08.348394 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:08.348296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:08.366016 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:08.365965    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj" podStartSLOduration=1.899936577 podStartE2EDuration="2.365948663s" totalImagesPullingTime="466.012086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:40:08.365514133 +0000 UTC m=+2097.738563924" watchObservedRunningTime="2026-07-26 15:40:08.365948663 +0000 UTC m=+2097.738998473"
Jul 26 15:40:08.384206 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:08.384160    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn" podStartSLOduration=1.38414664 podStartE2EDuration="1.38414664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:40:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:40:08.382592147 +0000 UTC m=+2097.755641927" watchObservedRunningTime="2026-07-26 15:40:08.38414664 +0000 UTC m=+2097.757196419"
Jul 26 15:40:14.358714 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:14.358680    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:17.822437 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:17.822396    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"]
Jul 26 15:40:17.825818 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:17.825800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"
Jul 26 15:40:17.828500 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:17.828482    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d665x\""
Jul 26 15:40:17.833595 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:17.833362    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"]
Jul 26 15:40:17.870820 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:17.870789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99397386-1f38-4929-856e-63fc9fe047fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c\" (UID: \"99397386-1f38-4929-856e-63fc9fe047fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"
Jul 26 15:40:17.971354 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:17.971320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99397386-1f38-4929-856e-63fc9fe047fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c\" (UID: \"99397386-1f38-4929-856e-63fc9fe047fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"
Jul 26 15:40:17.971950 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:17.971932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99397386-1f38-4929-856e-63fc9fe047fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c\" (UID: \"99397386-1f38-4929-856e-63fc9fe047fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"
Jul 26 15:40:18.137164 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:18.137078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"
Jul 26 15:40:18.263320 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:18.263265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"]
Jul 26 15:40:18.265628 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:40:18.265600    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99397386_1f38_4929_856e_63fc9fe047fc.slice/crio-0f8997c1bde310da0158e646d66017170a27fc6cbee0d6efb1d3ece3cd30f184 WatchSource:0}: Error finding container 0f8997c1bde310da0158e646d66017170a27fc6cbee0d6efb1d3ece3cd30f184: Status 404 returned error can't find the container with id 0f8997c1bde310da0158e646d66017170a27fc6cbee0d6efb1d3ece3cd30f184
Jul 26 15:40:18.397565 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:18.397488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c" event={"ID":"99397386-1f38-4929-856e-63fc9fe047fc","Type":"ContainerStarted","Data":"0f8997c1bde310da0158e646d66017170a27fc6cbee0d6efb1d3ece3cd30f184"}
Jul 26 15:40:19.355000 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:19.354966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:19.405007 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:19.404972    2580 generic.go:356] "Generic (PLEG): container finished" podID="99397386-1f38-4929-856e-63fc9fe047fc" containerID="7c67509bf7d0359137bf9add43025530e88fdf1fa0df1c0c19bde33266d5cb1f" exitCode=0
Jul 26 15:40:19.405007 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:19.405010    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c" event={"ID":"99397386-1f38-4929-856e-63fc9fe047fc","Type":"ContainerDied","Data":"7c67509bf7d0359137bf9add43025530e88fdf1fa0df1c0c19bde33266d5cb1f"}
Jul 26 15:40:20.541406 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:20.541381    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"
Jul 26 15:40:20.596989 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:20.596956    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99397386-1f38-4929-856e-63fc9fe047fc-maas-api-service-ca\") pod \"99397386-1f38-4929-856e-63fc9fe047fc\" (UID: \"99397386-1f38-4929-856e-63fc9fe047fc\") "
Jul 26 15:40:20.597343 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:20.597323    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99397386-1f38-4929-856e-63fc9fe047fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "99397386-1f38-4929-856e-63fc9fe047fc" (UID: "99397386-1f38-4929-856e-63fc9fe047fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:40:20.698656 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:20.698581    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99397386-1f38-4929-856e-63fc9fe047fc-maas-api-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:40:21.416226 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:21.416197    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"
Jul 26 15:40:21.416384 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:21.416244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c" event={"ID":"99397386-1f38-4929-856e-63fc9fe047fc","Type":"ContainerDied","Data":"0f8997c1bde310da0158e646d66017170a27fc6cbee0d6efb1d3ece3cd30f184"}
Jul 26 15:40:21.416384 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:21.416292    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f8997c1bde310da0158e646d66017170a27fc6cbee0d6efb1d3ece3cd30f184"
Jul 26 15:40:28.127502 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.127470    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"]
Jul 26 15:40:28.127953 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.127731    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj" podUID="2af749a7-0a3b-4937-bd64-6edf37939d62" containerName="maas-api" containerID="cri-o://625d34e0d8d6683e4398c5f0a83e7a769aa62b964e6b97aa14b5a9167bad5237" gracePeriod=30
Jul 26 15:40:28.186229 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.186197    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"]
Jul 26 15:40:28.186477 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.186450    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn" podUID="32a60f6d-2ca7-4495-aeef-821b7393d5b1" containerName="payload-pre-processing" containerID="cri-o://58c7e1f8a63a180bd46a5fc2bce095fd0849f949afe6b50110e7b871589fa22d" gracePeriod=30
Jul 26 15:40:28.451569 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.451540    2580 generic.go:356] "Generic (PLEG): container finished" podID="2af749a7-0a3b-4937-bd64-6edf37939d62" containerID="625d34e0d8d6683e4398c5f0a83e7a769aa62b964e6b97aa14b5a9167bad5237" exitCode=0
Jul 26 15:40:28.451690 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.451620    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj" event={"ID":"2af749a7-0a3b-4937-bd64-6edf37939d62","Type":"ContainerDied","Data":"625d34e0d8d6683e4398c5f0a83e7a769aa62b964e6b97aa14b5a9167bad5237"}
Jul 26 15:40:28.451747 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.451691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj" event={"ID":"2af749a7-0a3b-4937-bd64-6edf37939d62","Type":"ContainerDied","Data":"ce6c53d87813b4386c9d04de797625bfe43044cb5c2b6f8197e8bd3a1203781d"}
Jul 26 15:40:28.451747 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.451715    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce6c53d87813b4386c9d04de797625bfe43044cb5c2b6f8197e8bd3a1203781d"
Jul 26 15:40:28.452978 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.452957    2580 generic.go:356] "Generic (PLEG): container finished" podID="32a60f6d-2ca7-4495-aeef-821b7393d5b1" containerID="58c7e1f8a63a180bd46a5fc2bce095fd0849f949afe6b50110e7b871589fa22d" exitCode=0
Jul 26 15:40:28.453083 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.453039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn" event={"ID":"32a60f6d-2ca7-4495-aeef-821b7393d5b1","Type":"ContainerDied","Data":"58c7e1f8a63a180bd46a5fc2bce095fd0849f949afe6b50110e7b871589fa22d"}
Jul 26 15:40:28.453134 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.453096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn" event={"ID":"32a60f6d-2ca7-4495-aeef-821b7393d5b1","Type":"ContainerDied","Data":"2333959138f01e7ea1a8f41a78fa4843be3628bd3a43665695e6c06b5960129e"}
Jul 26 15:40:28.453134 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.453114    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2333959138f01e7ea1a8f41a78fa4843be3628bd3a43665695e6c06b5960129e"
Jul 26 15:40:28.460490 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.460469    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:28.463973 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.463952    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:28.570193 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.570160    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78g49\" (UniqueName: \"kubernetes.io/projected/2af749a7-0a3b-4937-bd64-6edf37939d62-kube-api-access-78g49\") pod \"2af749a7-0a3b-4937-bd64-6edf37939d62\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") "
Jul 26 15:40:28.570193 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.570192    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95q8p\" (UniqueName: \"kubernetes.io/projected/32a60f6d-2ca7-4495-aeef-821b7393d5b1-kube-api-access-95q8p\") pod \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\" (UID: \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\") "
Jul 26 15:40:28.570438 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.570270    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls\") pod \"2af749a7-0a3b-4937-bd64-6edf37939d62\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") "
Jul 26 15:40:28.570438 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.570288    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32a60f6d-2ca7-4495-aeef-821b7393d5b1-plugins-config-volume\") pod \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\" (UID: \"32a60f6d-2ca7-4495-aeef-821b7393d5b1\") "
Jul 26 15:40:28.570438 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.570324    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af749a7-0a3b-4937-bd64-6edf37939d62-openshift-service-ca\") pod \"2af749a7-0a3b-4937-bd64-6edf37939d62\" (UID: \"2af749a7-0a3b-4937-bd64-6edf37939d62\") "
Jul 26 15:40:28.570699 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.570674    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32a60f6d-2ca7-4495-aeef-821b7393d5b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "32a60f6d-2ca7-4495-aeef-821b7393d5b1" (UID: "32a60f6d-2ca7-4495-aeef-821b7393d5b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:40:28.570781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.570751    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af749a7-0a3b-4937-bd64-6edf37939d62-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2af749a7-0a3b-4937-bd64-6edf37939d62" (UID: "2af749a7-0a3b-4937-bd64-6edf37939d62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:40:28.572448 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.572427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af749a7-0a3b-4937-bd64-6edf37939d62-kube-api-access-78g49" (OuterVolumeSpecName: "kube-api-access-78g49") pod "2af749a7-0a3b-4937-bd64-6edf37939d62" (UID: "2af749a7-0a3b-4937-bd64-6edf37939d62"). InnerVolumeSpecName "kube-api-access-78g49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:40:28.572525 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.572446    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2af749a7-0a3b-4937-bd64-6edf37939d62" (UID: "2af749a7-0a3b-4937-bd64-6edf37939d62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:40:28.572525 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.572454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32a60f6d-2ca7-4495-aeef-821b7393d5b1-kube-api-access-95q8p" (OuterVolumeSpecName: "kube-api-access-95q8p") pod "32a60f6d-2ca7-4495-aeef-821b7393d5b1" (UID: "32a60f6d-2ca7-4495-aeef-821b7393d5b1"). InnerVolumeSpecName "kube-api-access-95q8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:40:28.672197 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.672162    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af749a7-0a3b-4937-bd64-6edf37939d62-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:40:28.672197 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.672193    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32a60f6d-2ca7-4495-aeef-821b7393d5b1-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:40:28.672197 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.672202    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af749a7-0a3b-4937-bd64-6edf37939d62-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:40:28.672446 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.672211    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78g49\" (UniqueName: \"kubernetes.io/projected/2af749a7-0a3b-4937-bd64-6edf37939d62-kube-api-access-78g49\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:40:28.672446 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:28.672220    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95q8p\" (UniqueName: \"kubernetes.io/projected/32a60f6d-2ca7-4495-aeef-821b7393d5b1-kube-api-access-95q8p\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:40:29.457664 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:29.457583    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"
Jul 26 15:40:29.458034 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:29.457583    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"
Jul 26 15:40:29.477785 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:29.477763    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"]
Jul 26 15:40:29.479599 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:29.479581    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1d5bf042-78cc48c5dc-kxsmj"]
Jul 26 15:40:29.489254 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:29.489230    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"]
Jul 26 15:40:29.492710 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:29.492690    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1d5bf042-c6fb5f6d-5qxtn"]
Jul 26 15:40:31.161551 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:31.161517    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af749a7-0a3b-4937-bd64-6edf37939d62" path="/var/lib/kubelet/pods/2af749a7-0a3b-4937-bd64-6edf37939d62/volumes"
Jul 26 15:40:31.161951 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:31.161880    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a60f6d-2ca7-4495-aeef-821b7393d5b1" path="/var/lib/kubelet/pods/32a60f6d-2ca7-4495-aeef-821b7393d5b1/volumes"
Jul 26 15:40:32.896188 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:32.896148    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"]
Jul 26 15:40:32.897997 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:32.897973    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1d5bf042-wl86c"]
Jul 26 15:40:33.160625 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:40:33.160544    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99397386-1f38-4929-856e-63fc9fe047fc" path="/var/lib/kubelet/pods/99397386-1f38-4929-856e-63fc9fe047fc/volumes"
Jul 26 15:41:01.501236 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501205    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"]
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501593    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af749a7-0a3b-4937-bd64-6edf37939d62" containerName="maas-api"
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501611    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af749a7-0a3b-4937-bd64-6edf37939d62" containerName="maas-api"
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501647    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99397386-1f38-4929-856e-63fc9fe047fc" containerName="revoke-keys"
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501656    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="99397386-1f38-4929-856e-63fc9fe047fc" containerName="revoke-keys"
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501671    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a60f6d-2ca7-4495-aeef-821b7393d5b1" containerName="payload-pre-processing"
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501682    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a60f6d-2ca7-4495-aeef-821b7393d5b1" containerName="payload-pre-processing"
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501766    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af749a7-0a3b-4937-bd64-6edf37939d62" containerName="maas-api"
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501775    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="99397386-1f38-4929-856e-63fc9fe047fc" containerName="revoke-keys"
Jul 26 15:41:01.501999 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.501783    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32a60f6d-2ca7-4495-aeef-821b7393d5b1" containerName="payload-pre-processing"
Jul 26 15:41:01.504934 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.504915    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:01.507699 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.507673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-52d355e1-serving-cert\""
Jul 26 15:41:01.515600 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.515574    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"]
Jul 26 15:41:01.582980 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.582940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dqbm\" (UniqueName: \"kubernetes.io/projected/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-kube-api-access-6dqbm\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:01.583155 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.583048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-openshift-service-ca\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:01.583155 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.583093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:01.684589 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.684552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dqbm\" (UniqueName: \"kubernetes.io/projected/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-kube-api-access-6dqbm\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:01.684767 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.684621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-openshift-service-ca\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:01.684767 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.684666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:01.684841 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:41:01.684815    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-serving-cert: secret "maas-api-e2e-mt-52d355e1-serving-cert" not found
Jul 26 15:41:01.684920 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:41:01.684909    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls podName:b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92 nodeName:}" failed. No retries permitted until 2026-07-26 15:41:02.184868907 +0000 UTC m=+2151.557918663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls") pod "maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp" (UID: "b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92") : secret "maas-api-e2e-mt-52d355e1-serving-cert" not found
Jul 26 15:41:01.685299 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.685279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-openshift-service-ca\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:01.693577 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:01.693545    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dqbm\" (UniqueName: \"kubernetes.io/projected/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-kube-api-access-6dqbm\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:02.188515 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.188477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:02.190901 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.190853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls\") pod \"maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:02.230723 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.230689    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"]
Jul 26 15:41:02.234335 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.234310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:02.237427 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.237405    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-52d355e1-dockercfg-dv7m9\""
Jul 26 15:41:02.237560 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.237405    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-52d355e1\""
Jul 26 15:41:02.248060 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.248032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"]
Jul 26 15:41:02.289995 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.289962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5psk8\" (UniqueName: \"kubernetes.io/projected/39ab1ad7-67ed-4183-9876-969882fd8f04-kube-api-access-5psk8\") pod \"payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k\" (UID: \"39ab1ad7-67ed-4183-9876-969882fd8f04\") " pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:02.290183 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.290024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39ab1ad7-67ed-4183-9876-969882fd8f04-plugins-config-volume\") pod \"payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k\" (UID: \"39ab1ad7-67ed-4183-9876-969882fd8f04\") " pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:02.391513 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.391473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39ab1ad7-67ed-4183-9876-969882fd8f04-plugins-config-volume\") pod \"payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k\" (UID: \"39ab1ad7-67ed-4183-9876-969882fd8f04\") " pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:02.391704 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.391564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5psk8\" (UniqueName: \"kubernetes.io/projected/39ab1ad7-67ed-4183-9876-969882fd8f04-kube-api-access-5psk8\") pod \"payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k\" (UID: \"39ab1ad7-67ed-4183-9876-969882fd8f04\") " pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:02.392261 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.392239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39ab1ad7-67ed-4183-9876-969882fd8f04-plugins-config-volume\") pod \"payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k\" (UID: \"39ab1ad7-67ed-4183-9876-969882fd8f04\") " pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:02.399578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.399553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5psk8\" (UniqueName: \"kubernetes.io/projected/39ab1ad7-67ed-4183-9876-969882fd8f04-kube-api-access-5psk8\") pod \"payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k\" (UID: \"39ab1ad7-67ed-4183-9876-969882fd8f04\") " pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:02.417880 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.417850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:02.545564 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.545525    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:02.548478 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.548454    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"]
Jul 26 15:41:02.551111 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:41:02.551085    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c3b572_d29b_4c5c_a2fb_4395bc5b5a92.slice/crio-48e52bda4278e22ee3203b4776fc1781b4c1f8aed515772584c07346eedbb220 WatchSource:0}: Error finding container 48e52bda4278e22ee3203b4776fc1781b4c1f8aed515772584c07346eedbb220: Status 404 returned error can't find the container with id 48e52bda4278e22ee3203b4776fc1781b4c1f8aed515772584c07346eedbb220
Jul 26 15:41:02.552282 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.552262    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:41:02.625769 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.625725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp" event={"ID":"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92","Type":"ContainerStarted","Data":"48e52bda4278e22ee3203b4776fc1781b4c1f8aed515772584c07346eedbb220"}
Jul 26 15:41:02.678603 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:02.678576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"]
Jul 26 15:41:02.681148 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:41:02.681121    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ab1ad7_67ed_4183_9876_969882fd8f04.slice/crio-312859e14d2095c8957db211c7270f752696dfa0fa13ca2aee63e9628d7cd05a WatchSource:0}: Error finding container 312859e14d2095c8957db211c7270f752696dfa0fa13ca2aee63e9628d7cd05a: Status 404 returned error can't find the container with id 312859e14d2095c8957db211c7270f752696dfa0fa13ca2aee63e9628d7cd05a
Jul 26 15:41:03.632279 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:03.632239    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k" event={"ID":"39ab1ad7-67ed-4183-9876-969882fd8f04","Type":"ContainerStarted","Data":"365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c"}
Jul 26 15:41:03.632733 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:03.632303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k" event={"ID":"39ab1ad7-67ed-4183-9876-969882fd8f04","Type":"ContainerStarted","Data":"312859e14d2095c8957db211c7270f752696dfa0fa13ca2aee63e9628d7cd05a"}
Jul 26 15:41:03.632733 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:03.632333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:41:03.633787 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:03.633763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp" event={"ID":"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92","Type":"ContainerStarted","Data":"fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99"}
Jul 26 15:41:03.633873 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:03.633811    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:03.649530 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:03.649483    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k" podStartSLOduration=1.649468976 podStartE2EDuration="1.649468976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:41:03.64788421 +0000 UTC m=+2153.020933990" watchObservedRunningTime="2026-07-26 15:41:03.649468976 +0000 UTC m=+2153.022518754"
Jul 26 15:41:03.667781 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:03.667739    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp" podStartSLOduration=2.131514254 podStartE2EDuration="2.667727599s" totalImagesPullingTime="536.213345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:41:03.665540427 +0000 UTC m=+2153.038590215" watchObservedRunningTime="2026-07-26 15:41:03.667727599 +0000 UTC m=+2153.040777377"
Jul 26 15:41:09.645154 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:09.645125    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:41:14.640842 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:41:14.640811    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:42:11.092108 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.092070    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"]
Jul 26 15:42:11.094734 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.092318    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp" podUID="b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" containerName="maas-api" containerID="cri-o://fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99" gracePeriod=30
Jul 26 15:42:11.143284 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.143255    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"]
Jul 26 15:42:11.143487 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.143462    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k" podUID="39ab1ad7-67ed-4183-9876-969882fd8f04" containerName="payload-processing" containerID="cri-o://365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c" gracePeriod=30
Jul 26 15:42:11.304871 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.304842    2580 scope.go:117] "RemoveContainer" containerID="99e3f7f6d6aa6c3af02b4eab6dbcd38588e166bc85a87d4d253e16fe2133a9b8"
Jul 26 15:42:11.398829 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.398805    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:42:11.428317 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.428293    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:42:11.495630 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.495601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dqbm\" (UniqueName: \"kubernetes.io/projected/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-kube-api-access-6dqbm\") pod \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") "
Jul 26 15:42:11.495766 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.495667    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls\") pod \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") "
Jul 26 15:42:11.495766 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.495725    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-openshift-service-ca\") pod \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\" (UID: \"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92\") "
Jul 26 15:42:11.496119 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.496094    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" (UID: "b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:42:11.497680 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.497657    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-kube-api-access-6dqbm" (OuterVolumeSpecName: "kube-api-access-6dqbm") pod "b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" (UID: "b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92"). InnerVolumeSpecName "kube-api-access-6dqbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:42:11.497755 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.497688    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" (UID: "b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:42:11.596509 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.596485    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5psk8\" (UniqueName: \"kubernetes.io/projected/39ab1ad7-67ed-4183-9876-969882fd8f04-kube-api-access-5psk8\") pod \"39ab1ad7-67ed-4183-9876-969882fd8f04\" (UID: \"39ab1ad7-67ed-4183-9876-969882fd8f04\") "
Jul 26 15:42:11.596613 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.596549    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39ab1ad7-67ed-4183-9876-969882fd8f04-plugins-config-volume\") pod \"39ab1ad7-67ed-4183-9876-969882fd8f04\" (UID: \"39ab1ad7-67ed-4183-9876-969882fd8f04\") "
Jul 26 15:42:11.596685 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.596673    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:42:11.596748 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.596687    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dqbm\" (UniqueName: \"kubernetes.io/projected/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-kube-api-access-6dqbm\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:42:11.596748 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.596696    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:42:11.596978 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.596956    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ab1ad7-67ed-4183-9876-969882fd8f04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39ab1ad7-67ed-4183-9876-969882fd8f04" (UID: "39ab1ad7-67ed-4183-9876-969882fd8f04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:42:11.598304 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.598286    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39ab1ad7-67ed-4183-9876-969882fd8f04-kube-api-access-5psk8" (OuterVolumeSpecName: "kube-api-access-5psk8") pod "39ab1ad7-67ed-4183-9876-969882fd8f04" (UID: "39ab1ad7-67ed-4183-9876-969882fd8f04"). InnerVolumeSpecName "kube-api-access-5psk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:42:11.697321 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.697257    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5psk8\" (UniqueName: \"kubernetes.io/projected/39ab1ad7-67ed-4183-9876-969882fd8f04-kube-api-access-5psk8\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:42:11.697321 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.697279    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39ab1ad7-67ed-4183-9876-969882fd8f04-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:42:11.965529 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.965448    2580 generic.go:356] "Generic (PLEG): container finished" podID="39ab1ad7-67ed-4183-9876-969882fd8f04" containerID="365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c" exitCode=0
Jul 26 15:42:11.965529 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.965491    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"
Jul 26 15:42:11.965746 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.965531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k" event={"ID":"39ab1ad7-67ed-4183-9876-969882fd8f04","Type":"ContainerDied","Data":"365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c"}
Jul 26 15:42:11.965746 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.965585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k" event={"ID":"39ab1ad7-67ed-4183-9876-969882fd8f04","Type":"ContainerDied","Data":"312859e14d2095c8957db211c7270f752696dfa0fa13ca2aee63e9628d7cd05a"}
Jul 26 15:42:11.965746 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.965621    2580 scope.go:117] "RemoveContainer" containerID="365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c"
Jul 26 15:42:11.966843 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.966826    2580 generic.go:356] "Generic (PLEG): container finished" podID="b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" containerID="fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99" exitCode=0
Jul 26 15:42:11.966935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.966874    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"
Jul 26 15:42:11.966935 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.966911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp" event={"ID":"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92","Type":"ContainerDied","Data":"fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99"}
Jul 26 15:42:11.967014 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.966966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp" event={"ID":"b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92","Type":"ContainerDied","Data":"48e52bda4278e22ee3203b4776fc1781b4c1f8aed515772584c07346eedbb220"}
Jul 26 15:42:11.974057 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.974039    2580 scope.go:117] "RemoveContainer" containerID="365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c"
Jul 26 15:42:11.974307 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:42:11.974290    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c\": container with ID starting with 365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c not found: ID does not exist" containerID="365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c"
Jul 26 15:42:11.974353 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.974315    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c"} err="failed to get container status \"365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c\": rpc error: code = NotFound desc = could not find container \"365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c\": container with ID starting with 365f03a5a4e2a6d52b3477508943d9df73216c80ae43b97ea93107a8b449df4c not found: ID does not exist"
Jul 26 15:42:11.974353 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.974331    2580 scope.go:117] "RemoveContainer" containerID="fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99"
Jul 26 15:42:11.983388 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.983371    2580 scope.go:117] "RemoveContainer" containerID="fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99"
Jul 26 15:42:11.983637 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:42:11.983618    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99\": container with ID starting with fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99 not found: ID does not exist" containerID="fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99"
Jul 26 15:42:11.983697 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.983645    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99"} err="failed to get container status \"fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99\": rpc error: code = NotFound desc = could not find container \"fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99\": container with ID starting with fded354fdbaaf7ba9cf1bdd0c54d523fd8d18f4d1aaed7882a7454cdca901b99 not found: ID does not exist"
Jul 26 15:42:11.990939 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.990919    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"]
Jul 26 15:42:11.992619 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:11.992599    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-52d355e1-6c7bdb5846-qb26k"]
Jul 26 15:42:12.002987 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:12.002966    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"]
Jul 26 15:42:12.004411 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:12.004393    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52d355e1-86dfdb4b7-whslp"]
Jul 26 15:42:13.161058 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:13.160971    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39ab1ad7-67ed-4183-9876-969882fd8f04" path="/var/lib/kubelet/pods/39ab1ad7-67ed-4183-9876-969882fd8f04/volumes"
Jul 26 15:42:13.161399 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:42:13.161381    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" path="/var/lib/kubelet/pods/b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92/volumes"
Jul 26 15:44:10.735004 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.734915    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"]
Jul 26 15:44:10.735594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.735457    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39ab1ad7-67ed-4183-9876-969882fd8f04" containerName="payload-processing"
Jul 26 15:44:10.735594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.735471    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="39ab1ad7-67ed-4183-9876-969882fd8f04" containerName="payload-processing"
Jul 26 15:44:10.735594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.735485    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" containerName="maas-api"
Jul 26 15:44:10.735594 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.735494    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" containerName="maas-api"
Jul 26 15:44:10.735825 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.735601    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="39ab1ad7-67ed-4183-9876-969882fd8f04" containerName="payload-processing"
Jul 26 15:44:10.735825 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.735617    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c3b572-d29b-4c5c-a2fb-4395bc5b5a92" containerName="maas-api"
Jul 26 15:44:10.739048 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.739025    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:10.741846 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.741825    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9e47ce-serving-cert\""
Jul 26 15:44:10.748225 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.748199    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"]
Jul 26 15:44:10.827671 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.827631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf7hf\" (UniqueName: \"kubernetes.io/projected/34982f5f-5d25-4354-9882-c724a436bd90-kube-api-access-bf7hf\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:10.827963 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.827941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:10.828096 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.828082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34982f5f-5d25-4354-9882-c724a436bd90-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:10.929317 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.929276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf7hf\" (UniqueName: \"kubernetes.io/projected/34982f5f-5d25-4354-9882-c724a436bd90-kube-api-access-bf7hf\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:10.929317 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.929321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:10.929598 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.929341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34982f5f-5d25-4354-9882-c724a436bd90-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:10.929598 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:44:10.929442    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-serving-cert: secret "maas-api-e2e-inf-a-9e47ce-serving-cert" not found
Jul 26 15:44:10.929598 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:44:10.929512    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls podName:34982f5f-5d25-4354-9882-c724a436bd90 nodeName:}" failed. No retries permitted until 2026-07-26 15:44:11.429490089 +0000 UTC m=+2340.802539858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls") pod "maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj" (UID: "34982f5f-5d25-4354-9882-c724a436bd90") : secret "maas-api-e2e-inf-a-9e47ce-serving-cert" not found
Jul 26 15:44:10.930093 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.930072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34982f5f-5d25-4354-9882-c724a436bd90-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:10.941540 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:10.941512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf7hf\" (UniqueName: \"kubernetes.io/projected/34982f5f-5d25-4354-9882-c724a436bd90-kube-api-access-bf7hf\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:11.363225 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.363192    2580 scope.go:117] "RemoveContainer" containerID="b2746edb543358d3e821e14c119b242ef8f6d8d923ec0d240bee530af898fb81"
Jul 26 15:44:11.372024 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.371999    2580 scope.go:117] "RemoveContainer" containerID="cd5472a22904a543c520d2fee60e14d24a8223d3f2950ae135cfc3614d6e0aa7"
Jul 26 15:44:11.434324 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.434286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:11.436873 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.436845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls\") pod \"maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:11.473646 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.473611    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"]
Jul 26 15:44:11.478990 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.478968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:11.482090 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.482070    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-9e47ce\""
Jul 26 15:44:11.482158 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.482077    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-9e47ce-dockercfg-fcbcs\""
Jul 26 15:44:11.488400 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.488369    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"]
Jul 26 15:44:11.535851 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.535810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd8pv\" (UniqueName: \"kubernetes.io/projected/0884b26f-db52-40dd-a585-13335e57afc6-kube-api-access-sd8pv\") pod \"payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh\" (UID: \"0884b26f-db52-40dd-a585-13335e57afc6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:11.536034 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.535951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0884b26f-db52-40dd-a585-13335e57afc6-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh\" (UID: \"0884b26f-db52-40dd-a585-13335e57afc6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:11.636496 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.636403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0884b26f-db52-40dd-a585-13335e57afc6-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh\" (UID: \"0884b26f-db52-40dd-a585-13335e57afc6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:11.636496 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.636470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd8pv\" (UniqueName: \"kubernetes.io/projected/0884b26f-db52-40dd-a585-13335e57afc6-kube-api-access-sd8pv\") pod \"payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh\" (UID: \"0884b26f-db52-40dd-a585-13335e57afc6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:11.637946 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.637801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0884b26f-db52-40dd-a585-13335e57afc6-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh\" (UID: \"0884b26f-db52-40dd-a585-13335e57afc6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:11.646729 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.646702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd8pv\" (UniqueName: \"kubernetes.io/projected/0884b26f-db52-40dd-a585-13335e57afc6-kube-api-access-sd8pv\") pod \"payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh\" (UID: \"0884b26f-db52-40dd-a585-13335e57afc6\") " pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:11.651496 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.651477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:11.786595 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.786567    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"]
Jul 26 15:44:11.788350 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:44:11.788322    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34982f5f_5d25_4354_9882_c724a436bd90.slice/crio-1edd982b0bd3a2425f3d0251bac331dfc4a09478c2288c01b64bad1ac2126e52 WatchSource:0}: Error finding container 1edd982b0bd3a2425f3d0251bac331dfc4a09478c2288c01b64bad1ac2126e52: Status 404 returned error can't find the container with id 1edd982b0bd3a2425f3d0251bac331dfc4a09478c2288c01b64bad1ac2126e52
Jul 26 15:44:11.791034 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.791012    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:11.921721 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:11.921620    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"]
Jul 26 15:44:11.923783 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:44:11.923758    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0884b26f_db52_40dd_a585_13335e57afc6.slice/crio-e3e7ab5ff1321e6a510bb2316425033316bfb50d29e5f709d1637f7c998d20fc WatchSource:0}: Error finding container e3e7ab5ff1321e6a510bb2316425033316bfb50d29e5f709d1637f7c998d20fc: Status 404 returned error can't find the container with id e3e7ab5ff1321e6a510bb2316425033316bfb50d29e5f709d1637f7c998d20fc
Jul 26 15:44:12.549941 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:12.549883    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh" event={"ID":"0884b26f-db52-40dd-a585-13335e57afc6","Type":"ContainerStarted","Data":"5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d"}
Jul 26 15:44:12.550145 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:12.549963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh" event={"ID":"0884b26f-db52-40dd-a585-13335e57afc6","Type":"ContainerStarted","Data":"e3e7ab5ff1321e6a510bb2316425033316bfb50d29e5f709d1637f7c998d20fc"}
Jul 26 15:44:12.550145 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:12.550011    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:12.551457 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:12.551435    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj" event={"ID":"34982f5f-5d25-4354-9882-c724a436bd90","Type":"ContainerStarted","Data":"e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc"}
Jul 26 15:44:12.551577 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:12.551470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj" event={"ID":"34982f5f-5d25-4354-9882-c724a436bd90","Type":"ContainerStarted","Data":"1edd982b0bd3a2425f3d0251bac331dfc4a09478c2288c01b64bad1ac2126e52"}
Jul 26 15:44:12.551618 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:12.551581    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:12.567754 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:12.567712    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh" podStartSLOduration=1.567698634 podStartE2EDuration="1.567698634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:44:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:44:12.566360331 +0000 UTC m=+2341.939410111" watchObservedRunningTime="2026-07-26 15:44:12.567698634 +0000 UTC m=+2341.940748412"
Jul 26 15:44:12.585543 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:12.585494    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj" podStartSLOduration=2.144578747 podStartE2EDuration="2.585481075s" totalImagesPullingTime="440.902328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:44:12.58482276 +0000 UTC m=+2341.957872553" watchObservedRunningTime="2026-07-26 15:44:12.585481075 +0000 UTC m=+2341.958530855"
Jul 26 15:44:18.563442 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.563413    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:44:18.677123 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.677086    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"]
Jul 26 15:44:18.681195 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.681170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.683932 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.683906    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-28fa20-serving-cert\""
Jul 26 15:44:18.691543 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.691522    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"]
Jul 26 15:44:18.798527 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.798486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/414ce174-f7e1-4090-901b-a36d2050de7a-maas-api-tls\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.798704 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.798635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/414ce174-f7e1-4090-901b-a36d2050de7a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.798704 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.798690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfdhp\" (UniqueName: \"kubernetes.io/projected/414ce174-f7e1-4090-901b-a36d2050de7a-kube-api-access-hfdhp\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.899748 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.899657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/414ce174-f7e1-4090-901b-a36d2050de7a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.899748 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.899698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfdhp\" (UniqueName: \"kubernetes.io/projected/414ce174-f7e1-4090-901b-a36d2050de7a-kube-api-access-hfdhp\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.899985 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.899915    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/414ce174-f7e1-4090-901b-a36d2050de7a-maas-api-tls\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.900357 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.900336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/414ce174-f7e1-4090-901b-a36d2050de7a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.902243 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.902222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/414ce174-f7e1-4090-901b-a36d2050de7a-maas-api-tls\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.909021 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.908996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfdhp\" (UniqueName: \"kubernetes.io/projected/414ce174-f7e1-4090-901b-a36d2050de7a-kube-api-access-hfdhp\") pod \"maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:18.994305 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:18.994267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:19.129475 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:19.129449    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"]
Jul 26 15:44:19.131877 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:44:19.131848    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414ce174_f7e1_4090_901b_a36d2050de7a.slice/crio-991e792a42659ed9915bacc02f6daf315f2afc73a4cfb88b8022af69e6683d16 WatchSource:0}: Error finding container 991e792a42659ed9915bacc02f6daf315f2afc73a4cfb88b8022af69e6683d16: Status 404 returned error can't find the container with id 991e792a42659ed9915bacc02f6daf315f2afc73a4cfb88b8022af69e6683d16
Jul 26 15:44:19.588124 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:19.588094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr" event={"ID":"414ce174-f7e1-4090-901b-a36d2050de7a","Type":"ContainerStarted","Data":"991e792a42659ed9915bacc02f6daf315f2afc73a4cfb88b8022af69e6683d16"}
Jul 26 15:44:20.594757 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:20.594724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr" event={"ID":"414ce174-f7e1-4090-901b-a36d2050de7a","Type":"ContainerStarted","Data":"d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c"}
Jul 26 15:44:20.595197 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:20.594879    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:44:20.613114 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:20.613061    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr" podStartSLOduration=2.168326856 podStartE2EDuration="2.613040859s" totalImagesPullingTime="444.714003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:44:20.610945405 +0000 UTC m=+2349.983995187" watchObservedRunningTime="2026-07-26 15:44:20.613040859 +0000 UTC m=+2349.986090637"
Jul 26 15:44:23.559310 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:23.559277    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:44:26.606556 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:44:26.606525    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:46:04.455456 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.455419    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"]
Jul 26 15:46:04.456081 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.455620    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj" podUID="34982f5f-5d25-4354-9882-c724a436bd90" containerName="maas-api" containerID="cri-o://e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc" gracePeriod=30
Jul 26 15:46:04.505800 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.505764    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"]
Jul 26 15:46:04.506298 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.506237    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh" podUID="0884b26f-db52-40dd-a585-13335e57afc6" containerName="payload-processing" containerID="cri-o://5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d" gracePeriod=30
Jul 26 15:46:04.758173 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.758148    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:46:04.791237 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.791209    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:46:04.878178 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.878141    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls\") pod \"34982f5f-5d25-4354-9882-c724a436bd90\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") "
Jul 26 15:46:04.878178 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.878176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd8pv\" (UniqueName: \"kubernetes.io/projected/0884b26f-db52-40dd-a585-13335e57afc6-kube-api-access-sd8pv\") pod \"0884b26f-db52-40dd-a585-13335e57afc6\" (UID: \"0884b26f-db52-40dd-a585-13335e57afc6\") "
Jul 26 15:46:04.878375 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.878250    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34982f5f-5d25-4354-9882-c724a436bd90-openshift-service-ca\") pod \"34982f5f-5d25-4354-9882-c724a436bd90\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") "
Jul 26 15:46:04.878375 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.878271    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0884b26f-db52-40dd-a585-13335e57afc6-plugins-config-volume\") pod \"0884b26f-db52-40dd-a585-13335e57afc6\" (UID: \"0884b26f-db52-40dd-a585-13335e57afc6\") "
Jul 26 15:46:04.878375 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.878314    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf7hf\" (UniqueName: \"kubernetes.io/projected/34982f5f-5d25-4354-9882-c724a436bd90-kube-api-access-bf7hf\") pod \"34982f5f-5d25-4354-9882-c724a436bd90\" (UID: \"34982f5f-5d25-4354-9882-c724a436bd90\") "
Jul 26 15:46:04.878684 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.878653    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34982f5f-5d25-4354-9882-c724a436bd90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34982f5f-5d25-4354-9882-c724a436bd90" (UID: "34982f5f-5d25-4354-9882-c724a436bd90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:46:04.878684 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.878670    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0884b26f-db52-40dd-a585-13335e57afc6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0884b26f-db52-40dd-a585-13335e57afc6" (UID: "0884b26f-db52-40dd-a585-13335e57afc6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:46:04.880425 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.880398    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34982f5f-5d25-4354-9882-c724a436bd90-kube-api-access-bf7hf" (OuterVolumeSpecName: "kube-api-access-bf7hf") pod "34982f5f-5d25-4354-9882-c724a436bd90" (UID: "34982f5f-5d25-4354-9882-c724a436bd90"). InnerVolumeSpecName "kube-api-access-bf7hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:46:04.880506 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.880471    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34982f5f-5d25-4354-9882-c724a436bd90" (UID: "34982f5f-5d25-4354-9882-c724a436bd90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:46:04.880545 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.880500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0884b26f-db52-40dd-a585-13335e57afc6-kube-api-access-sd8pv" (OuterVolumeSpecName: "kube-api-access-sd8pv") pod "0884b26f-db52-40dd-a585-13335e57afc6" (UID: "0884b26f-db52-40dd-a585-13335e57afc6"). InnerVolumeSpecName "kube-api-access-sd8pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:46:04.979390 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.979298    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf7hf\" (UniqueName: \"kubernetes.io/projected/34982f5f-5d25-4354-9882-c724a436bd90-kube-api-access-bf7hf\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:46:04.979390 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.979332    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34982f5f-5d25-4354-9882-c724a436bd90-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:46:04.979390 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.979342    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd8pv\" (UniqueName: \"kubernetes.io/projected/0884b26f-db52-40dd-a585-13335e57afc6-kube-api-access-sd8pv\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:46:04.979390 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.979351    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34982f5f-5d25-4354-9882-c724a436bd90-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:46:04.979390 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:04.979361    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0884b26f-db52-40dd-a585-13335e57afc6-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:46:05.120556 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.120518    2580 generic.go:356] "Generic (PLEG): container finished" podID="0884b26f-db52-40dd-a585-13335e57afc6" containerID="5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d" exitCode=0
Jul 26 15:46:05.120556 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.120558    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"
Jul 26 15:46:05.120808 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.120606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh" event={"ID":"0884b26f-db52-40dd-a585-13335e57afc6","Type":"ContainerDied","Data":"5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d"}
Jul 26 15:46:05.120808 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.120660    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh" event={"ID":"0884b26f-db52-40dd-a585-13335e57afc6","Type":"ContainerDied","Data":"e3e7ab5ff1321e6a510bb2316425033316bfb50d29e5f709d1637f7c998d20fc"}
Jul 26 15:46:05.120808 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.120688    2580 scope.go:117] "RemoveContainer" containerID="5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d"
Jul 26 15:46:05.122027 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.122004    2580 generic.go:356] "Generic (PLEG): container finished" podID="34982f5f-5d25-4354-9882-c724a436bd90" containerID="e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc" exitCode=0
Jul 26 15:46:05.122123 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.122032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj" event={"ID":"34982f5f-5d25-4354-9882-c724a436bd90","Type":"ContainerDied","Data":"e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc"}
Jul 26 15:46:05.122123 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.122055    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"
Jul 26 15:46:05.122123 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.122108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj" event={"ID":"34982f5f-5d25-4354-9882-c724a436bd90","Type":"ContainerDied","Data":"1edd982b0bd3a2425f3d0251bac331dfc4a09478c2288c01b64bad1ac2126e52"}
Jul 26 15:46:05.130326 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.130304    2580 scope.go:117] "RemoveContainer" containerID="5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d"
Jul 26 15:46:05.130603 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:46:05.130578    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d\": container with ID starting with 5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d not found: ID does not exist" containerID="5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d"
Jul 26 15:46:05.130681 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.130613    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d"} err="failed to get container status \"5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d\": rpc error: code = NotFound desc = could not find container \"5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d\": container with ID starting with 5d78f35a3decabef8d2b4971be134115b41c7f849d741890b35bdad36adc3d4d not found: ID does not exist"
Jul 26 15:46:05.130681 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.130630    2580 scope.go:117] "RemoveContainer" containerID="e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc"
Jul 26 15:46:05.138403 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.138386    2580 scope.go:117] "RemoveContainer" containerID="e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc"
Jul 26 15:46:05.138638 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:46:05.138621    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc\": container with ID starting with e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc not found: ID does not exist" containerID="e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc"
Jul 26 15:46:05.138684 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.138645    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc"} err="failed to get container status \"e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc\": rpc error: code = NotFound desc = could not find container \"e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc\": container with ID starting with e691c31826a9eec48959a17ca00dca2fea7c30faa2edd9b03100b6a7f2e5c6cc not found: ID does not exist"
Jul 26 15:46:05.143782 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.143762    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"]
Jul 26 15:46:05.155776 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.152591    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-9e47ce-774556788-4m5vh"]
Jul 26 15:46:05.162881 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.162853    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0884b26f-db52-40dd-a585-13335e57afc6" path="/var/lib/kubelet/pods/0884b26f-db52-40dd-a585-13335e57afc6/volumes"
Jul 26 15:46:05.170830 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.170809    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"]
Jul 26 15:46:05.179243 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:05.179222    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9e47ce-59c46d4bb4-qmzwj"]
Jul 26 15:46:07.159215 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:07.159182    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34982f5f-5d25-4354-9882-c724a436bd90" path="/var/lib/kubelet/pods/34982f5f-5d25-4354-9882-c724a436bd90/volumes"
Jul 26 15:46:11.401319 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:11.401286    2580 scope.go:117] "RemoveContainer" containerID="58c7e1f8a63a180bd46a5fc2bce095fd0849f949afe6b50110e7b871589fa22d"
Jul 26 15:46:11.411552 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:11.411528    2580 scope.go:117] "RemoveContainer" containerID="625d34e0d8d6683e4398c5f0a83e7a769aa62b964e6b97aa14b5a9167bad5237"
Jul 26 15:46:26.125290 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.125254    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"]
Jul 26 15:46:26.125773 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.125486    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr" podUID="414ce174-f7e1-4090-901b-a36d2050de7a" containerName="maas-api" containerID="cri-o://d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c" gracePeriod=30
Jul 26 15:46:26.569223 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.569199    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:46:26.678162 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.678075    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfdhp\" (UniqueName: \"kubernetes.io/projected/414ce174-f7e1-4090-901b-a36d2050de7a-kube-api-access-hfdhp\") pod \"414ce174-f7e1-4090-901b-a36d2050de7a\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") "
Jul 26 15:46:26.678314 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.678200    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/414ce174-f7e1-4090-901b-a36d2050de7a-openshift-service-ca\") pod \"414ce174-f7e1-4090-901b-a36d2050de7a\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") "
Jul 26 15:46:26.678314 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.678225    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/414ce174-f7e1-4090-901b-a36d2050de7a-maas-api-tls\") pod \"414ce174-f7e1-4090-901b-a36d2050de7a\" (UID: \"414ce174-f7e1-4090-901b-a36d2050de7a\") "
Jul 26 15:46:26.678588 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.678561    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/414ce174-f7e1-4090-901b-a36d2050de7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "414ce174-f7e1-4090-901b-a36d2050de7a" (UID: "414ce174-f7e1-4090-901b-a36d2050de7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:46:26.680188 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.680158    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414ce174-f7e1-4090-901b-a36d2050de7a-kube-api-access-hfdhp" (OuterVolumeSpecName: "kube-api-access-hfdhp") pod "414ce174-f7e1-4090-901b-a36d2050de7a" (UID: "414ce174-f7e1-4090-901b-a36d2050de7a"). InnerVolumeSpecName "kube-api-access-hfdhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:46:26.680301 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.680220    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414ce174-f7e1-4090-901b-a36d2050de7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "414ce174-f7e1-4090-901b-a36d2050de7a" (UID: "414ce174-f7e1-4090-901b-a36d2050de7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:46:26.779833 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.779777    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/414ce174-f7e1-4090-901b-a36d2050de7a-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:46:26.779833 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.779827    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/414ce174-f7e1-4090-901b-a36d2050de7a-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:46:26.779833 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:26.779839    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfdhp\" (UniqueName: \"kubernetes.io/projected/414ce174-f7e1-4090-901b-a36d2050de7a-kube-api-access-hfdhp\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:46:27.233936 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.233871    2580 generic.go:356] "Generic (PLEG): container finished" podID="414ce174-f7e1-4090-901b-a36d2050de7a" containerID="d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c" exitCode=0
Jul 26 15:46:27.233936 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.233925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr" event={"ID":"414ce174-f7e1-4090-901b-a36d2050de7a","Type":"ContainerDied","Data":"d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c"}
Jul 26 15:46:27.234427 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.233984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr" event={"ID":"414ce174-f7e1-4090-901b-a36d2050de7a","Type":"ContainerDied","Data":"991e792a42659ed9915bacc02f6daf315f2afc73a4cfb88b8022af69e6683d16"}
Jul 26 15:46:27.234427 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.234007    2580 scope.go:117] "RemoveContainer" containerID="d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c"
Jul 26 15:46:27.234427 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.233940    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"
Jul 26 15:46:27.242662 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.242646    2580 scope.go:117] "RemoveContainer" containerID="d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c"
Jul 26 15:46:27.242918 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:46:27.242896    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c\": container with ID starting with d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c not found: ID does not exist" containerID="d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c"
Jul 26 15:46:27.242970 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.242929    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c"} err="failed to get container status \"d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c\": rpc error: code = NotFound desc = could not find container \"d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c\": container with ID starting with d25770ab52b6315d0cc1a187c7a033dab1bec6d3e44720d54450aec6f77ea12c not found: ID does not exist"
Jul 26 15:46:27.251344 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.251321    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"]
Jul 26 15:46:27.255042 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:27.255021    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28fa20-6c9f547b5-4g4wr"]
Jul 26 15:46:29.159584 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:29.159551    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="414ce174-f7e1-4090-901b-a36d2050de7a" path="/var/lib/kubelet/pods/414ce174-f7e1-4090-901b-a36d2050de7a/volumes"
Jul 26 15:46:40.616875 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.616836    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"]
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617246    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414ce174-f7e1-4090-901b-a36d2050de7a" containerName="maas-api"
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617260    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="414ce174-f7e1-4090-901b-a36d2050de7a" containerName="maas-api"
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617270    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34982f5f-5d25-4354-9882-c724a436bd90" containerName="maas-api"
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617276    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="34982f5f-5d25-4354-9882-c724a436bd90" containerName="maas-api"
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617283    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0884b26f-db52-40dd-a585-13335e57afc6" containerName="payload-processing"
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617290    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0884b26f-db52-40dd-a585-13335e57afc6" containerName="payload-processing"
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617343    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0884b26f-db52-40dd-a585-13335e57afc6" containerName="payload-processing"
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617352    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="34982f5f-5d25-4354-9882-c724a436bd90" containerName="maas-api"
Jul 26 15:46:40.617385 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.617359    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="414ce174-f7e1-4090-901b-a36d2050de7a" containerName="maas-api"
Jul 26 15:46:40.621805 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.621788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:40.624575 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.624552    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2ad2c2-serving-cert\""
Jul 26 15:46:40.631329 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.631309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"]
Jul 26 15:46:40.720618 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.720581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:40.720785 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.720624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj6x8\" (UniqueName: \"kubernetes.io/projected/3a244014-3ef8-40f4-98f9-3b6600df628b-kube-api-access-bj6x8\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:40.720785 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.720709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a244014-3ef8-40f4-98f9-3b6600df628b-openshift-service-ca\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:40.821777 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.821742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:40.821777 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.821779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj6x8\" (UniqueName: \"kubernetes.io/projected/3a244014-3ef8-40f4-98f9-3b6600df628b-kube-api-access-bj6x8\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:40.822046 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.821810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a244014-3ef8-40f4-98f9-3b6600df628b-openshift-service-ca\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:40.822046 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:46:40.821929    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-serving-cert: secret "maas-api-e2e-api-a-2ad2c2-serving-cert" not found
Jul 26 15:46:40.822046 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:46:40.822020    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls podName:3a244014-3ef8-40f4-98f9-3b6600df628b nodeName:}" failed. No retries permitted until 2026-07-26 15:46:41.321997616 +0000 UTC m=+2490.695047376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls") pod "maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7" (UID: "3a244014-3ef8-40f4-98f9-3b6600df628b") : secret "maas-api-e2e-api-a-2ad2c2-serving-cert" not found
Jul 26 15:46:40.822486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.822465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a244014-3ef8-40f4-98f9-3b6600df628b-openshift-service-ca\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:40.831120 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:40.831090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj6x8\" (UniqueName: \"kubernetes.io/projected/3a244014-3ef8-40f4-98f9-3b6600df628b-kube-api-access-bj6x8\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:41.326468 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.326425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:41.328762 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.328731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls\") pod \"maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:41.377396 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.377364    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"]
Jul 26 15:46:41.380951 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.380930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:41.385732 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.385705    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-2ad2c2\""
Jul 26 15:46:41.391884 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.391861    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"]
Jul 26 15:46:41.528636 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.528597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aa61865-24f3-4970-8f23-2cdf4113142b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k\" (UID: \"5aa61865-24f3-4970-8f23-2cdf4113142b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:41.528636 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.528638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s8dp\" (UniqueName: \"kubernetes.io/projected/5aa61865-24f3-4970-8f23-2cdf4113142b-kube-api-access-5s8dp\") pod \"payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k\" (UID: \"5aa61865-24f3-4970-8f23-2cdf4113142b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:41.532433 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.532392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:41.629526 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.629487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aa61865-24f3-4970-8f23-2cdf4113142b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k\" (UID: \"5aa61865-24f3-4970-8f23-2cdf4113142b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:41.629526 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.629529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s8dp\" (UniqueName: \"kubernetes.io/projected/5aa61865-24f3-4970-8f23-2cdf4113142b-kube-api-access-5s8dp\") pod \"payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k\" (UID: \"5aa61865-24f3-4970-8f23-2cdf4113142b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:41.630198 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.630174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aa61865-24f3-4970-8f23-2cdf4113142b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k\" (UID: \"5aa61865-24f3-4970-8f23-2cdf4113142b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:41.638809 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.638785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s8dp\" (UniqueName: \"kubernetes.io/projected/5aa61865-24f3-4970-8f23-2cdf4113142b-kube-api-access-5s8dp\") pod \"payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k\" (UID: \"5aa61865-24f3-4970-8f23-2cdf4113142b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:41.662487 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.662459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"]
Jul 26 15:46:41.664248 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:46:41.664220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a244014_3ef8_40f4_98f9_3b6600df628b.slice/crio-36ed8d1b3911cf570e099d1bb341e6014d2f15909429b9292d51cb681ac17ee4 WatchSource:0}: Error finding container 36ed8d1b3911cf570e099d1bb341e6014d2f15909429b9292d51cb681ac17ee4: Status 404 returned error can't find the container with id 36ed8d1b3911cf570e099d1bb341e6014d2f15909429b9292d51cb681ac17ee4
Jul 26 15:46:41.665706 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.665688    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:46:41.694733 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.694704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:41.827119 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:41.827048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"]
Jul 26 15:46:41.829272 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:46:41.829244    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa61865_24f3_4970_8f23_2cdf4113142b.slice/crio-f41154d8b0cae4c1e2af9616d53e7c93fd7cf2ff9163fe905d3c3614095dc6ea WatchSource:0}: Error finding container f41154d8b0cae4c1e2af9616d53e7c93fd7cf2ff9163fe905d3c3614095dc6ea: Status 404 returned error can't find the container with id f41154d8b0cae4c1e2af9616d53e7c93fd7cf2ff9163fe905d3c3614095dc6ea
Jul 26 15:46:42.308837 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:42.308801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7" event={"ID":"3a244014-3ef8-40f4-98f9-3b6600df628b","Type":"ContainerStarted","Data":"10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c"}
Jul 26 15:46:42.309025 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:42.308863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7" event={"ID":"3a244014-3ef8-40f4-98f9-3b6600df628b","Type":"ContainerStarted","Data":"36ed8d1b3911cf570e099d1bb341e6014d2f15909429b9292d51cb681ac17ee4"}
Jul 26 15:46:42.309025 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:42.308988    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:42.310288 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:42.310263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k" event={"ID":"5aa61865-24f3-4970-8f23-2cdf4113142b","Type":"ContainerStarted","Data":"b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211"}
Jul 26 15:46:42.310421 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:42.310318    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:42.310421 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:42.310342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k" event={"ID":"5aa61865-24f3-4970-8f23-2cdf4113142b","Type":"ContainerStarted","Data":"f41154d8b0cae4c1e2af9616d53e7c93fd7cf2ff9163fe905d3c3614095dc6ea"}
Jul 26 15:46:42.326645 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:42.326600    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7" podStartSLOduration=1.7820341659999999 podStartE2EDuration="2.326584024s" totalImagesPullingTime="544.549858ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:46:42.324559381 +0000 UTC m=+2491.697609154" watchObservedRunningTime="2026-07-26 15:46:42.326584024 +0000 UTC m=+2491.699633804"
Jul 26 15:46:42.341040 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:42.340993    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k" podStartSLOduration=1.340980358 podStartE2EDuration="1.340980358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:46:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:46:42.339330715 +0000 UTC m=+2491.712380494" watchObservedRunningTime="2026-07-26 15:46:42.340980358 +0000 UTC m=+2491.714030136"
Jul 26 15:46:48.320544 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.320510    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:46:48.612173 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.612097    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"]
Jul 26 15:46:48.615852 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.615829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.618467 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.618445    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-14ba5c-serving-cert\""
Jul 26 15:46:48.625767 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.625742    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"]
Jul 26 15:46:48.692311 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.692270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b741aef8-592e-400d-a44e-e6d1a9227e0f-maas-api-tls\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.692509 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.692359    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b741aef8-592e-400d-a44e-e6d1a9227e0f-openshift-service-ca\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.692509 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.692422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84l7z\" (UniqueName: \"kubernetes.io/projected/b741aef8-592e-400d-a44e-e6d1a9227e0f-kube-api-access-84l7z\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.793332 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.793295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b741aef8-592e-400d-a44e-e6d1a9227e0f-maas-api-tls\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.793547 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.793392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b741aef8-592e-400d-a44e-e6d1a9227e0f-openshift-service-ca\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.793547 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.793454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84l7z\" (UniqueName: \"kubernetes.io/projected/b741aef8-592e-400d-a44e-e6d1a9227e0f-kube-api-access-84l7z\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.794147 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.794122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b741aef8-592e-400d-a44e-e6d1a9227e0f-openshift-service-ca\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.795825 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.795805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b741aef8-592e-400d-a44e-e6d1a9227e0f-maas-api-tls\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.802266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.802238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84l7z\" (UniqueName: \"kubernetes.io/projected/b741aef8-592e-400d-a44e-e6d1a9227e0f-kube-api-access-84l7z\") pod \"maas-api-e2e-api-b-14ba5c-764959f5d9-6989k\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:48.928014 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:48.927922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:49.077079 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.077013    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"]
Jul 26 15:46:49.079960 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:46:49.079935    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb741aef8_592e_400d_a44e_e6d1a9227e0f.slice/crio-686574131e9123613cf10797f05cf9ef7a5c9d6c077d0d9fe9717e1c19a629b6 WatchSource:0}: Error finding container 686574131e9123613cf10797f05cf9ef7a5c9d6c077d0d9fe9717e1c19a629b6: Status 404 returned error can't find the container with id 686574131e9123613cf10797f05cf9ef7a5c9d6c077d0d9fe9717e1c19a629b6
Jul 26 15:46:49.347425 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.347394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k" event={"ID":"b741aef8-592e-400d-a44e-e6d1a9227e0f","Type":"ContainerStarted","Data":"686574131e9123613cf10797f05cf9ef7a5c9d6c077d0d9fe9717e1c19a629b6"}
Jul 26 15:46:49.455689 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.455662    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"]
Jul 26 15:46:49.459030 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.459009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:49.462079 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.462061    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-14ba5c\""
Jul 26 15:46:49.462195 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.462075    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-14ba5c-dockercfg-jtz8c\""
Jul 26 15:46:49.473230 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.473205    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"]
Jul 26 15:46:49.500635 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.500602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv2qr\" (UniqueName: \"kubernetes.io/projected/8b99105e-b8d6-495c-88ac-ad0a98500ecf-kube-api-access-bv2qr\") pod \"payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4\" (UID: \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\") " pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:49.500786 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.500740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b99105e-b8d6-495c-88ac-ad0a98500ecf-plugins-config-volume\") pod \"payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4\" (UID: \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\") " pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:49.601303 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.601208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b99105e-b8d6-495c-88ac-ad0a98500ecf-plugins-config-volume\") pod \"payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4\" (UID: \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\") " pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:49.601303 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.601266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv2qr\" (UniqueName: \"kubernetes.io/projected/8b99105e-b8d6-495c-88ac-ad0a98500ecf-kube-api-access-bv2qr\") pod \"payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4\" (UID: \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\") " pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:49.602085 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.602065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b99105e-b8d6-495c-88ac-ad0a98500ecf-plugins-config-volume\") pod \"payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4\" (UID: \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\") " pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:49.609734 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.609701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv2qr\" (UniqueName: \"kubernetes.io/projected/8b99105e-b8d6-495c-88ac-ad0a98500ecf-kube-api-access-bv2qr\") pod \"payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4\" (UID: \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\") " pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:49.769253 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.769220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:49.898793 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:49.898764    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"]
Jul 26 15:46:49.901145 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:46:49.901115    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b99105e_b8d6_495c_88ac_ad0a98500ecf.slice/crio-9394703e6ff74cde56eb17e3aa33030f4dfeab3e40d5f7963274f0352a050820 WatchSource:0}: Error finding container 9394703e6ff74cde56eb17e3aa33030f4dfeab3e40d5f7963274f0352a050820: Status 404 returned error can't find the container with id 9394703e6ff74cde56eb17e3aa33030f4dfeab3e40d5f7963274f0352a050820
Jul 26 15:46:50.354419 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:50.354377    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4" event={"ID":"8b99105e-b8d6-495c-88ac-ad0a98500ecf","Type":"ContainerStarted","Data":"3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6"}
Jul 26 15:46:50.354952 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:50.354442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4" event={"ID":"8b99105e-b8d6-495c-88ac-ad0a98500ecf","Type":"ContainerStarted","Data":"9394703e6ff74cde56eb17e3aa33030f4dfeab3e40d5f7963274f0352a050820"}
Jul 26 15:46:50.354952 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:50.354474    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:46:50.356340 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:50.356307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k" event={"ID":"b741aef8-592e-400d-a44e-e6d1a9227e0f","Type":"ContainerStarted","Data":"779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397"}
Jul 26 15:46:50.356505 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:50.356368    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:46:50.371821 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:50.371761    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4" podStartSLOduration=1.3717473820000001 podStartE2EDuration="1.371747382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:46:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:46:50.370333432 +0000 UTC m=+2499.743383212" watchObservedRunningTime="2026-07-26 15:46:50.371747382 +0000 UTC m=+2499.744797157"
Jul 26 15:46:50.387832 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:50.387786    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k" podStartSLOduration=2.059937564 podStartE2EDuration="2.387769894s" totalImagesPullingTime="327.83233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:46:50.387058594 +0000 UTC m=+2499.760108374" watchObservedRunningTime="2026-07-26 15:46:50.387769894 +0000 UTC m=+2499.760819673"
Jul 26 15:46:53.317115 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:53.317083    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:46:56.367778 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:46:56.367743    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:47:01.364972 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:01.364935    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:47:11.439648 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:11.439616    2580 scope.go:117] "RemoveContainer" containerID="7c67509bf7d0359137bf9add43025530e88fdf1fa0df1c0c19bde33266d5cb1f"
Jul 26 15:47:16.654189 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:16.654151    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"]
Jul 26 15:47:16.654662 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:16.654386    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7" podUID="3a244014-3ef8-40f4-98f9-3b6600df628b" containerName="maas-api" containerID="cri-o://10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c" gracePeriod=30
Jul 26 15:47:16.710018 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:16.709983    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"]
Jul 26 15:47:16.710287 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:16.710230    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k" podUID="5aa61865-24f3-4970-8f23-2cdf4113142b" containerName="payload-pre-processing" containerID="cri-o://b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211" gracePeriod=30
Jul 26 15:47:16.960563 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:16.960537    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:47:16.992591 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:16.992568    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:47:17.050622 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.050590    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aa61865-24f3-4970-8f23-2cdf4113142b-plugins-config-volume\") pod \"5aa61865-24f3-4970-8f23-2cdf4113142b\" (UID: \"5aa61865-24f3-4970-8f23-2cdf4113142b\") "
Jul 26 15:47:17.050791 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.050639    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a244014-3ef8-40f4-98f9-3b6600df628b-openshift-service-ca\") pod \"3a244014-3ef8-40f4-98f9-3b6600df628b\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") "
Jul 26 15:47:17.050791 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.050666    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s8dp\" (UniqueName: \"kubernetes.io/projected/5aa61865-24f3-4970-8f23-2cdf4113142b-kube-api-access-5s8dp\") pod \"5aa61865-24f3-4970-8f23-2cdf4113142b\" (UID: \"5aa61865-24f3-4970-8f23-2cdf4113142b\") "
Jul 26 15:47:17.050791 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.050767    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj6x8\" (UniqueName: \"kubernetes.io/projected/3a244014-3ef8-40f4-98f9-3b6600df628b-kube-api-access-bj6x8\") pod \"3a244014-3ef8-40f4-98f9-3b6600df628b\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") "
Jul 26 15:47:17.050985 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.050807    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls\") pod \"3a244014-3ef8-40f4-98f9-3b6600df628b\" (UID: \"3a244014-3ef8-40f4-98f9-3b6600df628b\") "
Jul 26 15:47:17.051065 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.051034    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a244014-3ef8-40f4-98f9-3b6600df628b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a244014-3ef8-40f4-98f9-3b6600df628b" (UID: "3a244014-3ef8-40f4-98f9-3b6600df628b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:47:17.051120 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.051061    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aa61865-24f3-4970-8f23-2cdf4113142b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5aa61865-24f3-4970-8f23-2cdf4113142b" (UID: "5aa61865-24f3-4970-8f23-2cdf4113142b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:47:17.051199 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.051174    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5aa61865-24f3-4970-8f23-2cdf4113142b-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:17.051199 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.051202    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a244014-3ef8-40f4-98f9-3b6600df628b-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:17.052796 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.052769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a244014-3ef8-40f4-98f9-3b6600df628b" (UID: "3a244014-3ef8-40f4-98f9-3b6600df628b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:47:17.052916 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.052809    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aa61865-24f3-4970-8f23-2cdf4113142b-kube-api-access-5s8dp" (OuterVolumeSpecName: "kube-api-access-5s8dp") pod "5aa61865-24f3-4970-8f23-2cdf4113142b" (UID: "5aa61865-24f3-4970-8f23-2cdf4113142b"). InnerVolumeSpecName "kube-api-access-5s8dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:47:17.052916 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.052838    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a244014-3ef8-40f4-98f9-3b6600df628b-kube-api-access-bj6x8" (OuterVolumeSpecName: "kube-api-access-bj6x8") pod "3a244014-3ef8-40f4-98f9-3b6600df628b" (UID: "3a244014-3ef8-40f4-98f9-3b6600df628b"). InnerVolumeSpecName "kube-api-access-bj6x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:47:17.152652 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.152615    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s8dp\" (UniqueName: \"kubernetes.io/projected/5aa61865-24f3-4970-8f23-2cdf4113142b-kube-api-access-5s8dp\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:17.152652 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.152646    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj6x8\" (UniqueName: \"kubernetes.io/projected/3a244014-3ef8-40f4-98f9-3b6600df628b-kube-api-access-bj6x8\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:17.152652 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.152657    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a244014-3ef8-40f4-98f9-3b6600df628b-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:17.492354 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.492259    2580 generic.go:356] "Generic (PLEG): container finished" podID="3a244014-3ef8-40f4-98f9-3b6600df628b" containerID="10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c" exitCode=0
Jul 26 15:47:17.492354 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.492321    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"
Jul 26 15:47:17.492578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.492348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7" event={"ID":"3a244014-3ef8-40f4-98f9-3b6600df628b","Type":"ContainerDied","Data":"10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c"}
Jul 26 15:47:17.492578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.492425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7" event={"ID":"3a244014-3ef8-40f4-98f9-3b6600df628b","Type":"ContainerDied","Data":"36ed8d1b3911cf570e099d1bb341e6014d2f15909429b9292d51cb681ac17ee4"}
Jul 26 15:47:17.492578 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.492455    2580 scope.go:117] "RemoveContainer" containerID="10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c"
Jul 26 15:47:17.493761 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.493737    2580 generic.go:356] "Generic (PLEG): container finished" podID="5aa61865-24f3-4970-8f23-2cdf4113142b" containerID="b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211" exitCode=0
Jul 26 15:47:17.493861 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.493794    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"
Jul 26 15:47:17.493861 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.493804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k" event={"ID":"5aa61865-24f3-4970-8f23-2cdf4113142b","Type":"ContainerDied","Data":"b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211"}
Jul 26 15:47:17.493861 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.493847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k" event={"ID":"5aa61865-24f3-4970-8f23-2cdf4113142b","Type":"ContainerDied","Data":"f41154d8b0cae4c1e2af9616d53e7c93fd7cf2ff9163fe905d3c3614095dc6ea"}
Jul 26 15:47:17.501694 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.501676    2580 scope.go:117] "RemoveContainer" containerID="10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c"
Jul 26 15:47:17.501982 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:47:17.501960    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c\": container with ID starting with 10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c not found: ID does not exist" containerID="10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c"
Jul 26 15:47:17.502042 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.501993    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c"} err="failed to get container status \"10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c\": rpc error: code = NotFound desc = could not find container \"10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c\": container with ID starting with 10691d79fb7ec43d6376560f85571123f097aeec79e30ba5998233d27ac0557c not found: ID does not exist"
Jul 26 15:47:17.502042 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.502014    2580 scope.go:117] "RemoveContainer" containerID="b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211"
Jul 26 15:47:17.509900 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.509870    2580 scope.go:117] "RemoveContainer" containerID="b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211"
Jul 26 15:47:17.510225 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:47:17.510208    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211\": container with ID starting with b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211 not found: ID does not exist" containerID="b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211"
Jul 26 15:47:17.510289 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.510232    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211"} err="failed to get container status \"b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211\": rpc error: code = NotFound desc = could not find container \"b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211\": container with ID starting with b72c9bd6ba6f62b8756c93a2a1133d524239753755eee0776cc48cbf9e3f7211 not found: ID does not exist"
Jul 26 15:47:17.510405 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.510387    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"]
Jul 26 15:47:17.515324 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.515286    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-2ad2c2-66bcb5bc96-5cq4k"]
Jul 26 15:47:17.526079 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.526059    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"]
Jul 26 15:47:17.529899 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:17.529866    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2ad2c2-57cc8c859b-jzqm7"]
Jul 26 15:47:19.160274 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:19.160241    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a244014-3ef8-40f4-98f9-3b6600df628b" path="/var/lib/kubelet/pods/3a244014-3ef8-40f4-98f9-3b6600df628b/volumes"
Jul 26 15:47:19.160745 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:19.160725    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aa61865-24f3-4970-8f23-2cdf4113142b" path="/var/lib/kubelet/pods/5aa61865-24f3-4970-8f23-2cdf4113142b/volumes"
Jul 26 15:47:43.023823 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.023787    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"]
Jul 26 15:47:43.024441 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.024067    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k" podUID="b741aef8-592e-400d-a44e-e6d1a9227e0f" containerName="maas-api" containerID="cri-o://779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397" gracePeriod=30
Jul 26 15:47:43.082768 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.082725    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"]
Jul 26 15:47:43.083010 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.082981    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4" podUID="8b99105e-b8d6-495c-88ac-ad0a98500ecf" containerName="payload-processing" containerID="cri-o://3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6" gracePeriod=30
Jul 26 15:47:43.335655 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.335629    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:47:43.369127 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.369101    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:47:43.404539 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.404511    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84l7z\" (UniqueName: \"kubernetes.io/projected/b741aef8-592e-400d-a44e-e6d1a9227e0f-kube-api-access-84l7z\") pod \"b741aef8-592e-400d-a44e-e6d1a9227e0f\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") "
Jul 26 15:47:43.404539 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.404544    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b99105e-b8d6-495c-88ac-ad0a98500ecf-plugins-config-volume\") pod \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\" (UID: \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\") "
Jul 26 15:47:43.404738 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.404673    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b741aef8-592e-400d-a44e-e6d1a9227e0f-openshift-service-ca\") pod \"b741aef8-592e-400d-a44e-e6d1a9227e0f\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") "
Jul 26 15:47:43.404791 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.404751    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv2qr\" (UniqueName: \"kubernetes.io/projected/8b99105e-b8d6-495c-88ac-ad0a98500ecf-kube-api-access-bv2qr\") pod \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\" (UID: \"8b99105e-b8d6-495c-88ac-ad0a98500ecf\") "
Jul 26 15:47:43.404835 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.404822    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b741aef8-592e-400d-a44e-e6d1a9227e0f-maas-api-tls\") pod \"b741aef8-592e-400d-a44e-e6d1a9227e0f\" (UID: \"b741aef8-592e-400d-a44e-e6d1a9227e0f\") "
Jul 26 15:47:43.405015 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.404987    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b99105e-b8d6-495c-88ac-ad0a98500ecf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8b99105e-b8d6-495c-88ac-ad0a98500ecf" (UID: "8b99105e-b8d6-495c-88ac-ad0a98500ecf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:47:43.405104 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.405050    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b741aef8-592e-400d-a44e-e6d1a9227e0f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b741aef8-592e-400d-a44e-e6d1a9227e0f" (UID: "b741aef8-592e-400d-a44e-e6d1a9227e0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:47:43.405216 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.405191    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b99105e-b8d6-495c-88ac-ad0a98500ecf-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:43.405216 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.405215    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b741aef8-592e-400d-a44e-e6d1a9227e0f-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:43.406840 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.406815    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b741aef8-592e-400d-a44e-e6d1a9227e0f-kube-api-access-84l7z" (OuterVolumeSpecName: "kube-api-access-84l7z") pod "b741aef8-592e-400d-a44e-e6d1a9227e0f" (UID: "b741aef8-592e-400d-a44e-e6d1a9227e0f"). InnerVolumeSpecName "kube-api-access-84l7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:47:43.407231 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.407206    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b99105e-b8d6-495c-88ac-ad0a98500ecf-kube-api-access-bv2qr" (OuterVolumeSpecName: "kube-api-access-bv2qr") pod "8b99105e-b8d6-495c-88ac-ad0a98500ecf" (UID: "8b99105e-b8d6-495c-88ac-ad0a98500ecf"). InnerVolumeSpecName "kube-api-access-bv2qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:47:43.407349 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.407332    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b741aef8-592e-400d-a44e-e6d1a9227e0f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b741aef8-592e-400d-a44e-e6d1a9227e0f" (UID: "b741aef8-592e-400d-a44e-e6d1a9227e0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:47:43.506529 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.506488    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv2qr\" (UniqueName: \"kubernetes.io/projected/8b99105e-b8d6-495c-88ac-ad0a98500ecf-kube-api-access-bv2qr\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:43.506529 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.506521    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b741aef8-592e-400d-a44e-e6d1a9227e0f-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:43.506529 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.506536    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84l7z\" (UniqueName: \"kubernetes.io/projected/b741aef8-592e-400d-a44e-e6d1a9227e0f-kube-api-access-84l7z\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 15:47:43.622652 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.622552    2580 generic.go:356] "Generic (PLEG): container finished" podID="8b99105e-b8d6-495c-88ac-ad0a98500ecf" containerID="3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6" exitCode=0
Jul 26 15:47:43.622652 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.622619    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"
Jul 26 15:47:43.622652 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.622641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4" event={"ID":"8b99105e-b8d6-495c-88ac-ad0a98500ecf","Type":"ContainerDied","Data":"3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6"}
Jul 26 15:47:43.622966 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.622724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4" event={"ID":"8b99105e-b8d6-495c-88ac-ad0a98500ecf","Type":"ContainerDied","Data":"9394703e6ff74cde56eb17e3aa33030f4dfeab3e40d5f7963274f0352a050820"}
Jul 26 15:47:43.622966 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.622749    2580 scope.go:117] "RemoveContainer" containerID="3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6"
Jul 26 15:47:43.623948 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.623928    2580 generic.go:356] "Generic (PLEG): container finished" podID="b741aef8-592e-400d-a44e-e6d1a9227e0f" containerID="779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397" exitCode=0
Jul 26 15:47:43.624031 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.623988    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"
Jul 26 15:47:43.624031 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.624009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k" event={"ID":"b741aef8-592e-400d-a44e-e6d1a9227e0f","Type":"ContainerDied","Data":"779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397"}
Jul 26 15:47:43.624144 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.624051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k" event={"ID":"b741aef8-592e-400d-a44e-e6d1a9227e0f","Type":"ContainerDied","Data":"686574131e9123613cf10797f05cf9ef7a5c9d6c077d0d9fe9717e1c19a629b6"}
Jul 26 15:47:43.632121 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.631875    2580 scope.go:117] "RemoveContainer" containerID="3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6"
Jul 26 15:47:43.632295 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:47:43.632176    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6\": container with ID starting with 3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6 not found: ID does not exist" containerID="3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6"
Jul 26 15:47:43.632295 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.632214    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6"} err="failed to get container status \"3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6\": rpc error: code = NotFound desc = could not find container \"3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6\": container with ID starting with 3f5a3c5ccbc6b4b59daa1757af00105140225887bf1dd723d963353b6eac31e6 not found: ID does not exist"
Jul 26 15:47:43.632295 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.632237    2580 scope.go:117] "RemoveContainer" containerID="779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397"
Jul 26 15:47:43.640243 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.640219    2580 scope.go:117] "RemoveContainer" containerID="779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397"
Jul 26 15:47:43.640492 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:47:43.640470    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397\": container with ID starting with 779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397 not found: ID does not exist" containerID="779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397"
Jul 26 15:47:43.640550 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.640499    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397"} err="failed to get container status \"779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397\": rpc error: code = NotFound desc = could not find container \"779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397\": container with ID starting with 779571feb7e8822545003a561837cd915c9894bd3489dec1f781ac1608da3397 not found: ID does not exist"
Jul 26 15:47:43.646982 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.646961    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"]
Jul 26 15:47:43.651159 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.651136    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-14ba5c-c754ff958-zzmz4"]
Jul 26 15:47:43.661326 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.661303    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"]
Jul 26 15:47:43.665396 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:43.665373    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-14ba5c-764959f5d9-6989k"]
Jul 26 15:47:45.159969 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:45.159925    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b99105e-b8d6-495c-88ac-ad0a98500ecf" path="/var/lib/kubelet/pods/8b99105e-b8d6-495c-88ac-ad0a98500ecf/volumes"
Jul 26 15:47:45.160532 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:45.160510    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b741aef8-592e-400d-a44e-e6d1a9227e0f" path="/var/lib/kubelet/pods/b741aef8-592e-400d-a44e-e6d1a9227e0f/volumes"
Jul 26 15:47:58.035509 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035473    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"]
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035854    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aa61865-24f3-4970-8f23-2cdf4113142b" containerName="payload-pre-processing"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035866    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aa61865-24f3-4970-8f23-2cdf4113142b" containerName="payload-pre-processing"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035876    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b99105e-b8d6-495c-88ac-ad0a98500ecf" containerName="payload-processing"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035881    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b99105e-b8d6-495c-88ac-ad0a98500ecf" containerName="payload-processing"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035917    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a244014-3ef8-40f4-98f9-3b6600df628b" containerName="maas-api"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035923    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a244014-3ef8-40f4-98f9-3b6600df628b" containerName="maas-api"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035930    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b741aef8-592e-400d-a44e-e6d1a9227e0f" containerName="maas-api"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035936    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b741aef8-592e-400d-a44e-e6d1a9227e0f" containerName="maas-api"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.035997    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a244014-3ef8-40f4-98f9-3b6600df628b" containerName="maas-api"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.036006    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b99105e-b8d6-495c-88ac-ad0a98500ecf" containerName="payload-processing"
Jul 26 15:47:58.036011 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.036014    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b741aef8-592e-400d-a44e-e6d1a9227e0f" containerName="maas-api"
Jul 26 15:47:58.036561 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.036021    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aa61865-24f3-4970-8f23-2cdf4113142b" containerName="payload-pre-processing"
Jul 26 15:47:58.039187 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.039167    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.042014 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.041989    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a20d61-serving-cert\""
Jul 26 15:47:58.051855 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.051832    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"]
Jul 26 15:47:58.136672 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.136635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtfc7\" (UniqueName: \"kubernetes.io/projected/8acd2db9-c5da-4c5e-a30d-275031afe35e-kube-api-access-xtfc7\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.137008 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.136729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acd2db9-c5da-4c5e-a30d-275031afe35e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.137008 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.136774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.237824 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.237786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtfc7\" (UniqueName: \"kubernetes.io/projected/8acd2db9-c5da-4c5e-a30d-275031afe35e-kube-api-access-xtfc7\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.238070 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.237884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acd2db9-c5da-4c5e-a30d-275031afe35e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.238070 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.237962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.238191 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:47:58.238102    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-serving-cert: secret "maas-api-e2e-shared-a-a20d61-serving-cert" not found
Jul 26 15:47:58.238191 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:47:58.238173    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls podName:8acd2db9-c5da-4c5e-a30d-275031afe35e nodeName:}" failed. No retries permitted until 2026-07-26 15:47:58.738153224 +0000 UTC m=+2568.111203000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls") pod "maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps" (UID: "8acd2db9-c5da-4c5e-a30d-275031afe35e") : secret "maas-api-e2e-shared-a-a20d61-serving-cert" not found
Jul 26 15:47:58.238624 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.238600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acd2db9-c5da-4c5e-a30d-275031afe35e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.247497 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.247465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtfc7\" (UniqueName: \"kubernetes.io/projected/8acd2db9-c5da-4c5e-a30d-275031afe35e-kube-api-access-xtfc7\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.742095 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.742063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.744430 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.744408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls\") pod \"maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:58.879677 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.879638    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"]
Jul 26 15:47:58.883239 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.883221    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:58.885850 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.885826    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-a20d61\""
Jul 26 15:47:58.885995 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.885949    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-a20d61-dockercfg-5l886\""
Jul 26 15:47:58.892495 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.892472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"]
Jul 26 15:47:58.944240 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.944199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjh42\" (UniqueName: \"kubernetes.io/projected/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-kube-api-access-wjh42\") pod \"payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln\" (UID: \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:58.944450 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.944367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln\" (UID: \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:58.952092 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:58.952065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:59.045564 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.045526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln\" (UID: \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:59.046012 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.045580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjh42\" (UniqueName: \"kubernetes.io/projected/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-kube-api-access-wjh42\") pod \"payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln\" (UID: \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:59.046486 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.046457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln\" (UID: \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:59.054291 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.054265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjh42\" (UniqueName: \"kubernetes.io/projected/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-kube-api-access-wjh42\") pod \"payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln\" (UID: \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\") " pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:59.089994 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.089968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"]
Jul 26 15:47:59.091953 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:47:59.091926    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8acd2db9_c5da_4c5e_a30d_275031afe35e.slice/crio-26704452daf5058ff59a73f36b2c146b963547da8daf38da6456c737eafa85c8 WatchSource:0}: Error finding container 26704452daf5058ff59a73f36b2c146b963547da8daf38da6456c737eafa85c8: Status 404 returned error can't find the container with id 26704452daf5058ff59a73f36b2c146b963547da8daf38da6456c737eafa85c8
Jul 26 15:47:59.195798 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.195766    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:59.338938 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.338883    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"]
Jul 26 15:47:59.344042 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:47:59.344013    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27d0d51_83ee_4098_b5e0_7fd7c4b2a498.slice/crio-de9e18d1f292682283100742d19218cc678ce40aab1833b9a5d900b2a20c6b1b WatchSource:0}: Error finding container de9e18d1f292682283100742d19218cc678ce40aab1833b9a5d900b2a20c6b1b: Status 404 returned error can't find the container with id de9e18d1f292682283100742d19218cc678ce40aab1833b9a5d900b2a20c6b1b
Jul 26 15:47:59.701063 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.700953    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps" event={"ID":"8acd2db9-c5da-4c5e-a30d-275031afe35e","Type":"ContainerStarted","Data":"a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c"}
Jul 26 15:47:59.701063 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.701011    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps" event={"ID":"8acd2db9-c5da-4c5e-a30d-275031afe35e","Type":"ContainerStarted","Data":"26704452daf5058ff59a73f36b2c146b963547da8daf38da6456c737eafa85c8"}
Jul 26 15:47:59.701273 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.701150    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:47:59.702526 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.702500    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln" event={"ID":"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498","Type":"ContainerStarted","Data":"433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f"}
Jul 26 15:47:59.702639 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.702548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln" event={"ID":"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498","Type":"ContainerStarted","Data":"de9e18d1f292682283100742d19218cc678ce40aab1833b9a5d900b2a20c6b1b"}
Jul 26 15:47:59.702639 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.702570    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:47:59.719900 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:47:59.719828    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps" podStartSLOduration=1.356348506 podStartE2EDuration="1.71980863s" totalImagesPullingTime="363.460124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:47:59.717114549 +0000 UTC m=+2569.090164329" watchObservedRunningTime="2026-07-26 15:47:59.71980863 +0000 UTC m=+2569.092858414"
Jul 26 15:48:05.713996 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:05.713966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 15:48:05.732547 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:05.732493    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln" podStartSLOduration=7.732478814 podStartE2EDuration="7.732478814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:47:59.732063406 +0000 UTC m=+2569.105113185" watchObservedRunningTime="2026-07-26 15:48:05.732478814 +0000 UTC m=+2575.105528593"
Jul 26 15:48:06.079960 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.079921    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"]
Jul 26 15:48:06.084405 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.084379    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.087224 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.087195    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-60c814-serving-cert\""
Jul 26 15:48:06.093656 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.093040    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"]
Jul 26 15:48:06.214298 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.214260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.214491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.214411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-openshift-service-ca\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.214491 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.214462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrvrm\" (UniqueName: \"kubernetes.io/projected/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-kube-api-access-mrvrm\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.315160 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.315123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.315367 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.315198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-openshift-service-ca\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.315367 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.315239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrvrm\" (UniqueName: \"kubernetes.io/projected/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-kube-api-access-mrvrm\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.315367 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:48:06.315289    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-serving-cert: secret "maas-api-e2e-shared-b-60c814-serving-cert" not found
Jul 26 15:48:06.315533 ip-10-0-132-129 kubenswrapper[2580]: E0726 15:48:06.315378    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls podName:ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854 nodeName:}" failed. No retries permitted until 2026-07-26 15:48:06.815357033 +0000 UTC m=+2576.188406791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls") pod "maas-api-e2e-shared-b-60c814-645d8478b8-57pbm" (UID: "ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854") : secret "maas-api-e2e-shared-b-60c814-serving-cert" not found
Jul 26 15:48:06.315938 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.315919    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-openshift-service-ca\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.327300 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.327271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrvrm\" (UniqueName: \"kubernetes.io/projected/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-kube-api-access-mrvrm\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.819081 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.819044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.821505 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.821483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls\") pod \"maas-api-e2e-shared-b-60c814-645d8478b8-57pbm\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:06.916346 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.916298    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"]
Jul 26 15:48:06.919924 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.919880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:06.922825 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.922802    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-60c814-dockercfg-wcngj\""
Jul 26 15:48:06.922943 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.922825    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-60c814\""
Jul 26 15:48:06.930069 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.930045    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"]
Jul 26 15:48:06.998104 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:06.998075    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:07.020827 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.020797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjw6w\" (UniqueName: \"kubernetes.io/projected/94f29777-1ce6-40b5-976b-79dd2dcdf938-kube-api-access-mjw6w\") pod \"payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks\" (UID: \"94f29777-1ce6-40b5-976b-79dd2dcdf938\") " pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:07.021001 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.020884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94f29777-1ce6-40b5-976b-79dd2dcdf938-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks\" (UID: \"94f29777-1ce6-40b5-976b-79dd2dcdf938\") " pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:07.122289 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.122260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjw6w\" (UniqueName: \"kubernetes.io/projected/94f29777-1ce6-40b5-976b-79dd2dcdf938-kube-api-access-mjw6w\") pod \"payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks\" (UID: \"94f29777-1ce6-40b5-976b-79dd2dcdf938\") " pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:07.122473 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.122336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94f29777-1ce6-40b5-976b-79dd2dcdf938-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks\" (UID: \"94f29777-1ce6-40b5-976b-79dd2dcdf938\") " pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:07.123222 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.123199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94f29777-1ce6-40b5-976b-79dd2dcdf938-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks\" (UID: \"94f29777-1ce6-40b5-976b-79dd2dcdf938\") " pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:07.130519 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.130496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjw6w\" (UniqueName: \"kubernetes.io/projected/94f29777-1ce6-40b5-976b-79dd2dcdf938-kube-api-access-mjw6w\") pod \"payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks\" (UID: \"94f29777-1ce6-40b5-976b-79dd2dcdf938\") " pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:07.166543 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.166510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"]
Jul 26 15:48:07.170067 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:48:07.170043    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb4d4e8_63eb_4ef4_b00e_a66d8fbd7854.slice/crio-cd705ffd57ab9349b375efc2422cfae2bc11b73305a309afda7f8a2816cde27a WatchSource:0}: Error finding container cd705ffd57ab9349b375efc2422cfae2bc11b73305a309afda7f8a2816cde27a: Status 404 returned error can't find the container with id cd705ffd57ab9349b375efc2422cfae2bc11b73305a309afda7f8a2816cde27a
Jul 26 15:48:07.231600 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.231560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:07.363215 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.363182    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"]
Jul 26 15:48:07.365232 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:48:07.365189    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f29777_1ce6_40b5_976b_79dd2dcdf938.slice/crio-aeb382bf4a2a4210202f27aa97bd84cd71db3a688da646b6301c4df707896ddd WatchSource:0}: Error finding container aeb382bf4a2a4210202f27aa97bd84cd71db3a688da646b6301c4df707896ddd: Status 404 returned error can't find the container with id aeb382bf4a2a4210202f27aa97bd84cd71db3a688da646b6301c4df707896ddd
Jul 26 15:48:07.745275 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.745184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks" event={"ID":"94f29777-1ce6-40b5-976b-79dd2dcdf938","Type":"ContainerStarted","Data":"da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810"}
Jul 26 15:48:07.745275 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.745242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks" event={"ID":"94f29777-1ce6-40b5-976b-79dd2dcdf938","Type":"ContainerStarted","Data":"aeb382bf4a2a4210202f27aa97bd84cd71db3a688da646b6301c4df707896ddd"}
Jul 26 15:48:07.745516 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.745331    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:48:07.746758 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.746732    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm" event={"ID":"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854","Type":"ContainerStarted","Data":"6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077"}
Jul 26 15:48:07.746903 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.746781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm" event={"ID":"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854","Type":"ContainerStarted","Data":"cd705ffd57ab9349b375efc2422cfae2bc11b73305a309afda7f8a2816cde27a"}
Jul 26 15:48:07.746903 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.746809    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:07.762018 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.761962    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks" podStartSLOduration=1.761947521 podStartE2EDuration="1.761947521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:48:07.760582402 +0000 UTC m=+2577.133632183" watchObservedRunningTime="2026-07-26 15:48:07.761947521 +0000 UTC m=+2577.134997300"
Jul 26 15:48:07.780344 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:07.780297    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm" podStartSLOduration=1.440297682 podStartE2EDuration="1.78028334s" totalImagesPullingTime="339.985658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:48:07.779920139 +0000 UTC m=+2577.152969920" watchObservedRunningTime="2026-07-26 15:48:07.78028334 +0000 UTC m=+2577.153333118"
Jul 26 15:48:10.710492 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:10.710459    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 15:48:13.757231 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:13.757201    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 15:48:18.753446 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:48:18.753417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 15:57:54.513817 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.513780    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"]
Jul 26 15:57:54.517996 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.517974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.521457 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.521438    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-d57e1d-serving-cert\""
Jul 26 15:57:54.537144 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.537118    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"]
Jul 26 15:57:54.619537 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.619487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xf2h\" (UniqueName: \"kubernetes.io/projected/84bc0464-051d-4753-9fb8-b45a83628029-kube-api-access-9xf2h\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.619725 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.619548    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bc0464-051d-4753-9fb8-b45a83628029-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.619725 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.619591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bc0464-051d-4753-9fb8-b45a83628029-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.720288 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.720260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xf2h\" (UniqueName: \"kubernetes.io/projected/84bc0464-051d-4753-9fb8-b45a83628029-kube-api-access-9xf2h\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.720485 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.720301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bc0464-051d-4753-9fb8-b45a83628029-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.720485 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.720338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bc0464-051d-4753-9fb8-b45a83628029-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.721081 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.721057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bc0464-051d-4753-9fb8-b45a83628029-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.722670 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.722651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bc0464-051d-4753-9fb8-b45a83628029-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.750332 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.750300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xf2h\" (UniqueName: \"kubernetes.io/projected/84bc0464-051d-4753-9fb8-b45a83628029-kube-api-access-9xf2h\") pod \"maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:54.827978 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:54.827932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:55.170540 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.170515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"]
Jul 26 15:57:55.172881 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:57:55.172854    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bc0464_051d_4753_9fb8_b45a83628029.slice/crio-ac596cfbef9415b232f55b2409dca94973f03a3f01ca36b35c839a809f8d86c0 WatchSource:0}: Error finding container ac596cfbef9415b232f55b2409dca94973f03a3f01ca36b35c839a809f8d86c0: Status 404 returned error can't find the container with id ac596cfbef9415b232f55b2409dca94973f03a3f01ca36b35c839a809f8d86c0
Jul 26 15:57:55.174351 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.174331    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:57:55.233242 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.233206    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"]
Jul 26 15:57:55.237797 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.237774    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:55.240838 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.240808    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-d57e1d-dockercfg-8zw6h\""
Jul 26 15:57:55.240966 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.240947    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d57e1d\""
Jul 26 15:57:55.246331 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.246309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"]
Jul 26 15:57:55.328240 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.328201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mb7x\" (UniqueName: \"kubernetes.io/projected/624dbf82-0683-4c33-8dd5-87c92d5aec1f-kube-api-access-6mb7x\") pod \"payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr\" (UID: \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:55.328598 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.328569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624dbf82-0683-4c33-8dd5-87c92d5aec1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr\" (UID: \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:55.430062 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.429971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mb7x\" (UniqueName: \"kubernetes.io/projected/624dbf82-0683-4c33-8dd5-87c92d5aec1f-kube-api-access-6mb7x\") pod \"payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr\" (UID: \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:55.430062 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.430040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624dbf82-0683-4c33-8dd5-87c92d5aec1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr\" (UID: \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:55.430714 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.430691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624dbf82-0683-4c33-8dd5-87c92d5aec1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr\" (UID: \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:55.438352 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.438321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mb7x\" (UniqueName: \"kubernetes.io/projected/624dbf82-0683-4c33-8dd5-87c92d5aec1f-kube-api-access-6mb7x\") pod \"payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr\" (UID: \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:55.550910 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.550848    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:55.553170 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.553139    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7" event={"ID":"84bc0464-051d-4753-9fb8-b45a83628029","Type":"ContainerStarted","Data":"ac596cfbef9415b232f55b2409dca94973f03a3f01ca36b35c839a809f8d86c0"}
Jul 26 15:57:55.688318 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:55.688292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"]
Jul 26 15:57:55.690362 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:57:55.690335    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624dbf82_0683_4c33_8dd5_87c92d5aec1f.slice/crio-742bf513013b204c38b9f488c2c968e86013cd923b283aad2e56aa91a2ce9a86 WatchSource:0}: Error finding container 742bf513013b204c38b9f488c2c968e86013cd923b283aad2e56aa91a2ce9a86: Status 404 returned error can't find the container with id 742bf513013b204c38b9f488c2c968e86013cd923b283aad2e56aa91a2ce9a86
Jul 26 15:57:56.559038 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:56.558992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7" event={"ID":"84bc0464-051d-4753-9fb8-b45a83628029","Type":"ContainerStarted","Data":"c8e4cc5593be14e5b4cabf083bb5bf782bea3d629a90abab0412619dc5fd7a78"}
Jul 26 15:57:56.559506 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:56.559087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:57:56.560571 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:56.560541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr" event={"ID":"624dbf82-0683-4c33-8dd5-87c92d5aec1f","Type":"ContainerStarted","Data":"59bb70f1e69303b076207ef57f5993558de773588263e3dd61eca737a9f2ef1e"}
Jul 26 15:57:56.560678 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:56.560590    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr" event={"ID":"624dbf82-0683-4c33-8dd5-87c92d5aec1f","Type":"ContainerStarted","Data":"742bf513013b204c38b9f488c2c968e86013cd923b283aad2e56aa91a2ce9a86"}
Jul 26 15:57:56.560678 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:56.560621    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:57:56.579227 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:56.579182    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7" podStartSLOduration=2.165405684 podStartE2EDuration="2.579167618s" totalImagesPullingTime="413.761934ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:57:56.577925661 +0000 UTC m=+3165.950975442" watchObservedRunningTime="2026-07-26 15:57:56.579167618 +0000 UTC m=+3165.952217397"
Jul 26 15:57:56.594309 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:57:56.594260    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr" podStartSLOduration=1.59424707 podStartE2EDuration="1.59424707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:57:56.593119574 +0000 UTC m=+3165.966169353" watchObservedRunningTime="2026-07-26 15:57:56.59424707 +0000 UTC m=+3165.967296848"
Jul 26 15:58:02.570236 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:02.570207    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 15:58:07.566731 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:07.566698    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 15:58:14.550302 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.550266    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"]
Jul 26 15:58:14.555063 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.555046    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:14.558140 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.558120    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-cb6b99\""
Jul 26 15:58:14.569641 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.569616    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"]
Jul 26 15:58:14.601681 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.601656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nndsc\" (UniqueName: \"kubernetes.io/projected/7103ed6e-5961-425a-8396-cca578e306b5-kube-api-access-nndsc\") pod \"payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk\" (UID: \"7103ed6e-5961-425a-8396-cca578e306b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:14.601780 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.601732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7103ed6e-5961-425a-8396-cca578e306b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk\" (UID: \"7103ed6e-5961-425a-8396-cca578e306b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:14.653314 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.653289    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"]
Jul 26 15:58:14.656660 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.656645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:14.660388 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.660369    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-cb6b99-dockercfg-5bgfh\""
Jul 26 15:58:14.667543 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.667524    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"]
Jul 26 15:58:14.702559 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.702531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nndsc\" (UniqueName: \"kubernetes.io/projected/7103ed6e-5961-425a-8396-cca578e306b5-kube-api-access-nndsc\") pod \"payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk\" (UID: \"7103ed6e-5961-425a-8396-cca578e306b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:14.702731 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.702625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad63453-b9b4-4a29-b336-da01961fdbf1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv\" (UID: \"3ad63453-b9b4-4a29-b336-da01961fdbf1\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:14.702807 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.702751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7103ed6e-5961-425a-8396-cca578e306b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk\" (UID: \"7103ed6e-5961-425a-8396-cca578e306b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:14.702864 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.702834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qxqw\" (UniqueName: \"kubernetes.io/projected/3ad63453-b9b4-4a29-b336-da01961fdbf1-kube-api-access-4qxqw\") pod \"payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv\" (UID: \"3ad63453-b9b4-4a29-b336-da01961fdbf1\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:14.703514 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.703491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7103ed6e-5961-425a-8396-cca578e306b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk\" (UID: \"7103ed6e-5961-425a-8396-cca578e306b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:14.711752 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.711718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nndsc\" (UniqueName: \"kubernetes.io/projected/7103ed6e-5961-425a-8396-cca578e306b5-kube-api-access-nndsc\") pod \"payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk\" (UID: \"7103ed6e-5961-425a-8396-cca578e306b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:14.803995 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.803913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad63453-b9b4-4a29-b336-da01961fdbf1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv\" (UID: \"3ad63453-b9b4-4a29-b336-da01961fdbf1\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:14.804138 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.804031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qxqw\" (UniqueName: \"kubernetes.io/projected/3ad63453-b9b4-4a29-b336-da01961fdbf1-kube-api-access-4qxqw\") pod \"payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv\" (UID: \"3ad63453-b9b4-4a29-b336-da01961fdbf1\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:14.804598 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.804577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad63453-b9b4-4a29-b336-da01961fdbf1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv\" (UID: \"3ad63453-b9b4-4a29-b336-da01961fdbf1\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:14.812589 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.812562    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qxqw\" (UniqueName: \"kubernetes.io/projected/3ad63453-b9b4-4a29-b336-da01961fdbf1-kube-api-access-4qxqw\") pod \"payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv\" (UID: \"3ad63453-b9b4-4a29-b336-da01961fdbf1\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:14.865498 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.865473    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:14.967256 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:14.967224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:15.002051 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.001979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"]
Jul 26 15:58:15.004336 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:58:15.004306    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7103ed6e_5961_425a_8396_cca578e306b5.slice/crio-ae13a8ccfc2d2785ca245ef2686f433fcd3030f68f3fad438a85a68bd8c2e21a WatchSource:0}: Error finding container ae13a8ccfc2d2785ca245ef2686f433fcd3030f68f3fad438a85a68bd8c2e21a: Status 404 returned error can't find the container with id ae13a8ccfc2d2785ca245ef2686f433fcd3030f68f3fad438a85a68bd8c2e21a
Jul 26 15:58:15.129697 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.129668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"]
Jul 26 15:58:15.132083 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:58:15.132043    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad63453_b9b4_4a29_b336_da01961fdbf1.slice/crio-8a37e12565ca7d55e7026baa448a4c719dc0b01ffc4365c98009be6e3095dc3b WatchSource:0}: Error finding container 8a37e12565ca7d55e7026baa448a4c719dc0b01ffc4365c98009be6e3095dc3b: Status 404 returned error can't find the container with id 8a37e12565ca7d55e7026baa448a4c719dc0b01ffc4365c98009be6e3095dc3b
Jul 26 15:58:15.655717 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.655658    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv" event={"ID":"3ad63453-b9b4-4a29-b336-da01961fdbf1","Type":"ContainerStarted","Data":"098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2"}
Jul 26 15:58:15.656202 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.655742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv" event={"ID":"3ad63453-b9b4-4a29-b336-da01961fdbf1","Type":"ContainerStarted","Data":"8a37e12565ca7d55e7026baa448a4c719dc0b01ffc4365c98009be6e3095dc3b"}
Jul 26 15:58:15.656202 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.655769    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:15.657145 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.657123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk" event={"ID":"7103ed6e-5961-425a-8396-cca578e306b5","Type":"ContainerStarted","Data":"160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73"}
Jul 26 15:58:15.657247 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.657165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk" event={"ID":"7103ed6e-5961-425a-8396-cca578e306b5","Type":"ContainerStarted","Data":"ae13a8ccfc2d2785ca245ef2686f433fcd3030f68f3fad438a85a68bd8c2e21a"}
Jul 26 15:58:15.657247 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.657188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:15.673088 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.673041    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv" podStartSLOduration=1.673028434 podStartE2EDuration="1.673028434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:15.671619588 +0000 UTC m=+3185.044669367" watchObservedRunningTime="2026-07-26 15:58:15.673028434 +0000 UTC m=+3185.046078214"
Jul 26 15:58:15.687661 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:15.687622    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk" podStartSLOduration=1.6876104280000002 podStartE2EDuration="1.687610428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:15.686400234 +0000 UTC m=+3185.059450015" watchObservedRunningTime="2026-07-26 15:58:15.687610428 +0000 UTC m=+3185.060660207"
Jul 26 15:58:26.664439 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:26.664406    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 15:58:26.666845 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:26.664480    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 15:58:35.143145 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:35.143114    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cfcqq_186e7423-63a1-4de7-8017-bf79a30146b1/payload-processing/0.log"
Jul 26 15:58:35.258154 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:58:35.258123    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv_3ad63453-b9b4-4a29-b336-da01961fdbf1/payload-processing/0.log"
Jul 26 15:59:35.472985 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:35.472953    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cfcqq_186e7423-63a1-4de7-8017-bf79a30146b1/payload-processing/0.log"
Jul 26 15:59:35.584007 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:35.583983    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv_3ad63453-b9b4-4a29-b336-da01961fdbf1/payload-processing/0.log"
Jul 26 15:59:36.141367 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.141329    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"]
Jul 26 15:59:36.145328 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.145307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.148768 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.148747    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-35252a-openshift-default-dockercfg-h84gh\""
Jul 26 15:59:36.160567 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.160543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"]
Jul 26 15:59:36.234272 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-istio-token\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.234459 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj2ht\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-kube-api-access-hj2ht\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.234459 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-envoy\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.234459 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-credential-socket\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.234620 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-certs\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.234620 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ae785-1f07-4976-b01c-97a98f25f37e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.234620 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-socket\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.234853 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-data\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.234951 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.234881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ae785-1f07-4976-b01c-97a98f25f37e-istio-podinfo\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-istio-token\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336365 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj2ht\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-kube-api-access-hj2ht\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336592 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-envoy\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336592 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-credential-socket\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336592 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-certs\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336742 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ae785-1f07-4976-b01c-97a98f25f37e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336742 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-socket\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336742 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-data\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336742 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ae785-1f07-4976-b01c-97a98f25f37e-istio-podinfo\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.336990 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.336960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-certs\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.337067 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.337011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-credential-socket\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.337233 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.337210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-data\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.337547 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.337524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ae785-1f07-4976-b01c-97a98f25f37e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.337659 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.337641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-socket\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.338855 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.338827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-envoy\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.339172 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.339156    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ae785-1f07-4976-b01c-97a98f25f37e-istio-podinfo\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.344688 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.344665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-istio-token\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.344768 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.344709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj2ht\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-kube-api-access-hj2ht\") pod \"e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") " pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.456779 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.456704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:36.594124 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.594096    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"]
Jul 26 15:59:36.596317 ip-10-0-132-129 kubenswrapper[2580]: W0726 15:59:36.596286    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953ae785_1f07_4976_b01c_97a98f25f37e.slice/crio-7bbd4a2eaf5b4b6598978bfb1c90b228312fbba7fc7e09fb53707145e2406bea WatchSource:0}: Error finding container 7bbd4a2eaf5b4b6598978bfb1c90b228312fbba7fc7e09fb53707145e2406bea: Status 404 returned error can't find the container with id 7bbd4a2eaf5b4b6598978bfb1c90b228312fbba7fc7e09fb53707145e2406bea
Jul 26 15:59:36.598660 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.598627    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:59:36.598725 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.598698    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:59:36.598764 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:36.598730    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:59:37.068912 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:37.068870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" event={"ID":"953ae785-1f07-4976-b01c-97a98f25f37e","Type":"ContainerStarted","Data":"0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10"}
Jul 26 15:59:37.069090 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:37.068933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" event={"ID":"953ae785-1f07-4976-b01c-97a98f25f37e","Type":"ContainerStarted","Data":"7bbd4a2eaf5b4b6598978bfb1c90b228312fbba7fc7e09fb53707145e2406bea"}
Jul 26 15:59:37.090122 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:37.090066    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" podStartSLOduration=1.09004649 podStartE2EDuration="1.09004649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:59:37.089399717 +0000 UTC m=+3266.462449498" watchObservedRunningTime="2026-07-26 15:59:37.09004649 +0000 UTC m=+3266.463096272"
Jul 26 15:59:37.457034 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:37.456945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:37.462057 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:37.462037    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:38.073439 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:38.073403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:38.074396 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:38.074373    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:53.075237 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:53.075156    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 26 15:59:53.075237 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:53.075222    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 26 15:59:53.161663 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:53.161574    2580 generic.go:356] "Generic (PLEG): container finished" podID="953ae785-1f07-4976-b01c-97a98f25f37e" containerID="0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10" exitCode=0
Jul 26 15:59:53.161663 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:53.161641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" event={"ID":"953ae785-1f07-4976-b01c-97a98f25f37e","Type":"ContainerDied","Data":"0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10"}
Jul 26 15:59:53.162091 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:53.162077    2580 scope.go:117] "RemoveContainer" containerID="0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10"
Jul 26 15:59:53.163268 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:53.163234    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:59:53.163345 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:53.163328    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:59:53.163392 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:53.163375    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 26 15:59:54.168101 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:54.168066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" event={"ID":"953ae785-1f07-4976-b01c-97a98f25f37e","Type":"ContainerStarted","Data":"98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5"}
Jul 26 15:59:54.457576 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:54.457480    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:54.457840 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:54.457817    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 26 15:59:54.457916 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:54.457869    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 26 15:59:55.457627 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:55.457584    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 26 15:59:55.458051 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:55.457650    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 26 15:59:56.457840 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:56.457797    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 26 15:59:56.458266 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:56.457856    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 26 15:59:57.457906 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:57.457864    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 26 15:59:57.458311 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:57.457956    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 26 15:59:58.461875 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:58.461842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:58.462245 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:58.462203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 15:59:58.462800 ip-10-0-132-129 kubenswrapper[2580]: I0726 15:59:58.462784    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 16:00:15.909907 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:15.909845    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"]
Jul 26 16:00:15.910409 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:15.910120    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy" containerID="cri-o://98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5" gracePeriod=30
Jul 26 16:00:21.172792 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.172731    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 16:00:21.295584 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295554    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ae785-1f07-4976-b01c-97a98f25f37e-istio-podinfo\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.295780 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295591    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-istio-token\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.295780 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295609    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ae785-1f07-4976-b01c-97a98f25f37e-istiod-ca-cert\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.295780 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-credential-socket\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.295780 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-socket\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.295780 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295733    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-data\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.295780 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295760    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-certs\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.296128 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj2ht\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-kube-api-access-hj2ht\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.296128 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.295822    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-envoy\") pod \"953ae785-1f07-4976-b01c-97a98f25f37e\" (UID: \"953ae785-1f07-4976-b01c-97a98f25f37e\") "
Jul 26 16:00:21.296128 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.296066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:00:21.296269 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.296186    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:00:21.296269 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.296190    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953ae785-1f07-4976-b01c-97a98f25f37e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:00:21.296269 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.296216    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-credential-socket\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:21.296414 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.296332    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:00:21.296688 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.296658    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-data" (OuterVolumeSpecName: "istio-data") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:00:21.298066 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.298038    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/953ae785-1f07-4976-b01c-97a98f25f37e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:00:21.298155 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.298059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-istio-token" (OuterVolumeSpecName: "istio-token") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:00:21.298155 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.298082    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:00:21.298276 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.298253    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-kube-api-access-hj2ht" (OuterVolumeSpecName: "kube-api-access-hj2ht") pod "953ae785-1f07-4976-b01c-97a98f25f37e" (UID: "953ae785-1f07-4976-b01c-97a98f25f37e"). InnerVolumeSpecName "kube-api-access-hj2ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:00:21.304334 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.304308    2580 generic.go:356] "Generic (PLEG): container finished" podID="953ae785-1f07-4976-b01c-97a98f25f37e" containerID="98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5" exitCode=0
Jul 26 16:00:21.304433 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.304356    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"
Jul 26 16:00:21.304433 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.304390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" event={"ID":"953ae785-1f07-4976-b01c-97a98f25f37e","Type":"ContainerDied","Data":"98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5"}
Jul 26 16:00:21.304549 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.304455    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz" event={"ID":"953ae785-1f07-4976-b01c-97a98f25f37e","Type":"ContainerDied","Data":"7bbd4a2eaf5b4b6598978bfb1c90b228312fbba7fc7e09fb53707145e2406bea"}
Jul 26 16:00:21.304549 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.304490    2580 scope.go:117] "RemoveContainer" containerID="98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5"
Jul 26 16:00:21.319299 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.319283    2580 scope.go:117] "RemoveContainer" containerID="0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10"
Jul 26 16:00:21.327193 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.327177    2580 scope.go:117] "RemoveContainer" containerID="98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5"
Jul 26 16:00:21.327473 ip-10-0-132-129 kubenswrapper[2580]: E0726 16:00:21.327451    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5\": container with ID starting with 98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5 not found: ID does not exist" containerID="98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5"
Jul 26 16:00:21.327550 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.327480    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5"} err="failed to get container status \"98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5\": rpc error: code = NotFound desc = could not find container \"98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5\": container with ID starting with 98ac09a529101279d711c797da21f9a44f5b455edb1589cbc2c42a474324f6c5 not found: ID does not exist"
Jul 26 16:00:21.327550 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.327496    2580 scope.go:117] "RemoveContainer" containerID="0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10"
Jul 26 16:00:21.327777 ip-10-0-132-129 kubenswrapper[2580]: E0726 16:00:21.327751    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10\": container with ID starting with 0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10 not found: ID does not exist" containerID="0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10"
Jul 26 16:00:21.327832 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.327784    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10"} err="failed to get container status \"0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10\": rpc error: code = NotFound desc = could not find container \"0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10\": container with ID starting with 0a96a352c5ebc77995f4a6d8bac47700315d2e30aa0d91db444fe96d5f6e4f10 not found: ID does not exist"
Jul 26 16:00:21.330650 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.330628    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"]
Jul 26 16:00:21.334033 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.334013    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-35252a-openshift-default-7b745cbbb4-sq9sz"]
Jul 26 16:00:21.397181 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.397153    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-socket\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:21.397181 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.397178    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-data\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:21.397339 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.397188    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-workload-certs\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:21.397339 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.397197    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj2ht\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-kube-api-access-hj2ht\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:21.397339 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.397206    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/953ae785-1f07-4976-b01c-97a98f25f37e-istio-envoy\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:21.397339 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.397214    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/953ae785-1f07-4976-b01c-97a98f25f37e-istio-podinfo\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:21.397339 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.397227    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/953ae785-1f07-4976-b01c-97a98f25f37e-istio-token\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:21.397339 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:21.397243    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/953ae785-1f07-4976-b01c-97a98f25f37e-istiod-ca-cert\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:23.160773 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:23.160731    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" path="/var/lib/kubelet/pods/953ae785-1f07-4976-b01c-97a98f25f37e/volumes"
Jul 26 16:00:35.077730 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.077649    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"]
Jul 26 16:00:35.078202 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.077859    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7" podUID="84bc0464-051d-4753-9fb8-b45a83628029" containerName="maas-api" containerID="cri-o://c8e4cc5593be14e5b4cabf083bb5bf782bea3d629a90abab0412619dc5fd7a78" gracePeriod=30
Jul 26 16:00:35.164706 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.164667    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"]
Jul 26 16:00:35.164935 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.164875    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr" podUID="624dbf82-0683-4c33-8dd5-87c92d5aec1f" containerName="payload-pre-processing" containerID="cri-o://59bb70f1e69303b076207ef57f5993558de773588263e3dd61eca737a9f2ef1e" gracePeriod=30
Jul 26 16:00:35.381571 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.381390    2580 generic.go:356] "Generic (PLEG): container finished" podID="84bc0464-051d-4753-9fb8-b45a83628029" containerID="c8e4cc5593be14e5b4cabf083bb5bf782bea3d629a90abab0412619dc5fd7a78" exitCode=0
Jul 26 16:00:35.381571 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.381499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7" event={"ID":"84bc0464-051d-4753-9fb8-b45a83628029","Type":"ContainerDied","Data":"c8e4cc5593be14e5b4cabf083bb5bf782bea3d629a90abab0412619dc5fd7a78"}
Jul 26 16:00:35.383584 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.383557    2580 generic.go:356] "Generic (PLEG): container finished" podID="624dbf82-0683-4c33-8dd5-87c92d5aec1f" containerID="59bb70f1e69303b076207ef57f5993558de773588263e3dd61eca737a9f2ef1e" exitCode=0
Jul 26 16:00:35.383761 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.383644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr" event={"ID":"624dbf82-0683-4c33-8dd5-87c92d5aec1f","Type":"ContainerDied","Data":"59bb70f1e69303b076207ef57f5993558de773588263e3dd61eca737a9f2ef1e"}
Jul 26 16:00:35.432288 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.432263    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 16:00:35.437284 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.437259    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xf2h\" (UniqueName: \"kubernetes.io/projected/84bc0464-051d-4753-9fb8-b45a83628029-kube-api-access-9xf2h\") pod \"84bc0464-051d-4753-9fb8-b45a83628029\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") "
Jul 26 16:00:35.437404 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.437322    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bc0464-051d-4753-9fb8-b45a83628029-openshift-service-ca\") pod \"84bc0464-051d-4753-9fb8-b45a83628029\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") "
Jul 26 16:00:35.437404 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.437368    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bc0464-051d-4753-9fb8-b45a83628029-maas-api-tls\") pod \"84bc0464-051d-4753-9fb8-b45a83628029\" (UID: \"84bc0464-051d-4753-9fb8-b45a83628029\") "
Jul 26 16:00:35.437734 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.437704    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84bc0464-051d-4753-9fb8-b45a83628029-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84bc0464-051d-4753-9fb8-b45a83628029" (UID: "84bc0464-051d-4753-9fb8-b45a83628029"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:00:35.439416 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.439388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84bc0464-051d-4753-9fb8-b45a83628029-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84bc0464-051d-4753-9fb8-b45a83628029" (UID: "84bc0464-051d-4753-9fb8-b45a83628029"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:00:35.439498 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.439481    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84bc0464-051d-4753-9fb8-b45a83628029-kube-api-access-9xf2h" (OuterVolumeSpecName: "kube-api-access-9xf2h") pod "84bc0464-051d-4753-9fb8-b45a83628029" (UID: "84bc0464-051d-4753-9fb8-b45a83628029"). InnerVolumeSpecName "kube-api-access-9xf2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:00:35.458498 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.458473    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 16:00:35.538668 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.538640    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mb7x\" (UniqueName: \"kubernetes.io/projected/624dbf82-0683-4c33-8dd5-87c92d5aec1f-kube-api-access-6mb7x\") pod \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\" (UID: \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\") "
Jul 26 16:00:35.538668 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.538672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624dbf82-0683-4c33-8dd5-87c92d5aec1f-plugins-config-volume\") pod \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\" (UID: \"624dbf82-0683-4c33-8dd5-87c92d5aec1f\") "
Jul 26 16:00:35.538912 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.538822    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xf2h\" (UniqueName: \"kubernetes.io/projected/84bc0464-051d-4753-9fb8-b45a83628029-kube-api-access-9xf2h\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:35.538912 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.538834    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84bc0464-051d-4753-9fb8-b45a83628029-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:35.538912 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.538844    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84bc0464-051d-4753-9fb8-b45a83628029-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:35.539087 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.539062    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/624dbf82-0683-4c33-8dd5-87c92d5aec1f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "624dbf82-0683-4c33-8dd5-87c92d5aec1f" (UID: "624dbf82-0683-4c33-8dd5-87c92d5aec1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:00:35.540664 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.540645    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/624dbf82-0683-4c33-8dd5-87c92d5aec1f-kube-api-access-6mb7x" (OuterVolumeSpecName: "kube-api-access-6mb7x") pod "624dbf82-0683-4c33-8dd5-87c92d5aec1f" (UID: "624dbf82-0683-4c33-8dd5-87c92d5aec1f"). InnerVolumeSpecName "kube-api-access-6mb7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:00:35.639864 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.639779    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mb7x\" (UniqueName: \"kubernetes.io/projected/624dbf82-0683-4c33-8dd5-87c92d5aec1f-kube-api-access-6mb7x\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:35.639864 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:35.639805    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624dbf82-0683-4c33-8dd5-87c92d5aec1f-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:00:36.390139 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.390057    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"
Jul 26 16:00:36.390579 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.390058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7" event={"ID":"84bc0464-051d-4753-9fb8-b45a83628029","Type":"ContainerDied","Data":"ac596cfbef9415b232f55b2409dca94973f03a3f01ca36b35c839a809f8d86c0"}
Jul 26 16:00:36.390579 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.390198    2580 scope.go:117] "RemoveContainer" containerID="c8e4cc5593be14e5b4cabf083bb5bf782bea3d629a90abab0412619dc5fd7a78"
Jul 26 16:00:36.391609 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.391474    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"
Jul 26 16:00:36.391609 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.391506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr" event={"ID":"624dbf82-0683-4c33-8dd5-87c92d5aec1f","Type":"ContainerDied","Data":"742bf513013b204c38b9f488c2c968e86013cd923b283aad2e56aa91a2ce9a86"}
Jul 26 16:00:36.400203 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.400183    2580 scope.go:117] "RemoveContainer" containerID="59bb70f1e69303b076207ef57f5993558de773588263e3dd61eca737a9f2ef1e"
Jul 26 16:00:36.413000 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.412974    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"]
Jul 26 16:00:36.416816 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.416794    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d57e1d-77cc9dbff7-v5jz7"]
Jul 26 16:00:36.426955 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.426931    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"]
Jul 26 16:00:36.429672 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:36.429649    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d57e1d-6877b8b788-g79sr"]
Jul 26 16:00:37.159955 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:37.159922    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="624dbf82-0683-4c33-8dd5-87c92d5aec1f" path="/var/lib/kubelet/pods/624dbf82-0683-4c33-8dd5-87c92d5aec1f/volumes"
Jul 26 16:00:37.160459 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:00:37.160440    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84bc0464-051d-4753-9fb8-b45a83628029" path="/var/lib/kubelet/pods/84bc0464-051d-4753-9fb8-b45a83628029/volumes"
Jul 26 16:01:44.391654 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.391605    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"]
Jul 26 16:01:44.392204 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.391856    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv" podUID="3ad63453-b9b4-4a29-b336-da01961fdbf1" containerName="payload-processing" containerID="cri-o://098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2" gracePeriod=30
Jul 26 16:01:44.397996 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.397956    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"]
Jul 26 16:01:44.398230 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.398185    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk" podUID="7103ed6e-5961-425a-8396-cca578e306b5" containerName="payload-pre-processing" containerID="cri-o://160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73" gracePeriod=30
Jul 26 16:01:44.693563 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.693540    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 16:01:44.696364 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.696342    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 16:01:44.723984 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.723954    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ad63453-b9b4-4a29-b336-da01961fdbf1" containerID="098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2" exitCode=0
Jul 26 16:01:44.724142 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.724008    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"
Jul 26 16:01:44.724142 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.724032    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv" event={"ID":"3ad63453-b9b4-4a29-b336-da01961fdbf1","Type":"ContainerDied","Data":"098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2"}
Jul 26 16:01:44.724142 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.724083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv" event={"ID":"3ad63453-b9b4-4a29-b336-da01961fdbf1","Type":"ContainerDied","Data":"8a37e12565ca7d55e7026baa448a4c719dc0b01ffc4365c98009be6e3095dc3b"}
Jul 26 16:01:44.724142 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.724113    2580 scope.go:117] "RemoveContainer" containerID="098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2"
Jul 26 16:01:44.726172 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.725966    2580 generic.go:356] "Generic (PLEG): container finished" podID="7103ed6e-5961-425a-8396-cca578e306b5" containerID="160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73" exitCode=0
Jul 26 16:01:44.726172 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.726026    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"
Jul 26 16:01:44.726172 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.726033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk" event={"ID":"7103ed6e-5961-425a-8396-cca578e306b5","Type":"ContainerDied","Data":"160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73"}
Jul 26 16:01:44.726172 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.726077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk" event={"ID":"7103ed6e-5961-425a-8396-cca578e306b5","Type":"ContainerDied","Data":"ae13a8ccfc2d2785ca245ef2686f433fcd3030f68f3fad438a85a68bd8c2e21a"}
Jul 26 16:01:44.734782 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.734762    2580 scope.go:117] "RemoveContainer" containerID="098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2"
Jul 26 16:01:44.735119 ip-10-0-132-129 kubenswrapper[2580]: E0726 16:01:44.735090    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2\": container with ID starting with 098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2 not found: ID does not exist" containerID="098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2"
Jul 26 16:01:44.735193 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.735131    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2"} err="failed to get container status \"098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2\": rpc error: code = NotFound desc = could not find container \"098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2\": container with ID starting with 098505b9700906eece8547ab80d8db27d7f4f395261e9531c4983fb462fa93d2 not found: ID does not exist"
Jul 26 16:01:44.735193 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.735154    2580 scope.go:117] "RemoveContainer" containerID="160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73"
Jul 26 16:01:44.742936 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.742916    2580 scope.go:117] "RemoveContainer" containerID="160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73"
Jul 26 16:01:44.743167 ip-10-0-132-129 kubenswrapper[2580]: E0726 16:01:44.743147    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73\": container with ID starting with 160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73 not found: ID does not exist" containerID="160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73"
Jul 26 16:01:44.743231 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.743171    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73"} err="failed to get container status \"160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73\": rpc error: code = NotFound desc = could not find container \"160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73\": container with ID starting with 160bde49c7d640812071050a1373813575a00e5887bc590c304f7be074894b73 not found: ID does not exist"
Jul 26 16:01:44.879831 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.879802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nndsc\" (UniqueName: \"kubernetes.io/projected/7103ed6e-5961-425a-8396-cca578e306b5-kube-api-access-nndsc\") pod \"7103ed6e-5961-425a-8396-cca578e306b5\" (UID: \"7103ed6e-5961-425a-8396-cca578e306b5\") "
Jul 26 16:01:44.879987 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.879856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7103ed6e-5961-425a-8396-cca578e306b5-plugins-config-volume\") pod \"7103ed6e-5961-425a-8396-cca578e306b5\" (UID: \"7103ed6e-5961-425a-8396-cca578e306b5\") "
Jul 26 16:01:44.879987 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.879876    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qxqw\" (UniqueName: \"kubernetes.io/projected/3ad63453-b9b4-4a29-b336-da01961fdbf1-kube-api-access-4qxqw\") pod \"3ad63453-b9b4-4a29-b336-da01961fdbf1\" (UID: \"3ad63453-b9b4-4a29-b336-da01961fdbf1\") "
Jul 26 16:01:44.879987 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.879954    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad63453-b9b4-4a29-b336-da01961fdbf1-plugins-config-volume\") pod \"3ad63453-b9b4-4a29-b336-da01961fdbf1\" (UID: \"3ad63453-b9b4-4a29-b336-da01961fdbf1\") "
Jul 26 16:01:44.880349 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.880317    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7103ed6e-5961-425a-8396-cca578e306b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7103ed6e-5961-425a-8396-cca578e306b5" (UID: "7103ed6e-5961-425a-8396-cca578e306b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:01:44.880466 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.880354    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ad63453-b9b4-4a29-b336-da01961fdbf1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3ad63453-b9b4-4a29-b336-da01961fdbf1" (UID: "3ad63453-b9b4-4a29-b336-da01961fdbf1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:01:44.881931 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.881909    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7103ed6e-5961-425a-8396-cca578e306b5-kube-api-access-nndsc" (OuterVolumeSpecName: "kube-api-access-nndsc") pod "7103ed6e-5961-425a-8396-cca578e306b5" (UID: "7103ed6e-5961-425a-8396-cca578e306b5"). InnerVolumeSpecName "kube-api-access-nndsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:01:44.882025 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.881942    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad63453-b9b4-4a29-b336-da01961fdbf1-kube-api-access-4qxqw" (OuterVolumeSpecName: "kube-api-access-4qxqw") pod "3ad63453-b9b4-4a29-b336-da01961fdbf1" (UID: "3ad63453-b9b4-4a29-b336-da01961fdbf1"). InnerVolumeSpecName "kube-api-access-4qxqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:01:44.980754 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.980666    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ad63453-b9b4-4a29-b336-da01961fdbf1-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:01:44.980754 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.980708    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nndsc\" (UniqueName: \"kubernetes.io/projected/7103ed6e-5961-425a-8396-cca578e306b5-kube-api-access-nndsc\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:01:44.980754 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.980721    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7103ed6e-5961-425a-8396-cca578e306b5-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:01:44.980754 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:44.980730    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qxqw\" (UniqueName: \"kubernetes.io/projected/3ad63453-b9b4-4a29-b336-da01961fdbf1-kube-api-access-4qxqw\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:01:45.049433 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:45.049409    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"]
Jul 26 16:01:45.053902 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:45.053863    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cb6b99-7bd78b8464-frxnk"]
Jul 26 16:01:45.065103 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:45.065077    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"]
Jul 26 16:01:45.067616 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:45.067594    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cb6b99-68576d6c74-2bprv"]
Jul 26 16:01:45.160816 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:45.160787    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad63453-b9b4-4a29-b336-da01961fdbf1" path="/var/lib/kubelet/pods/3ad63453-b9b4-4a29-b336-da01961fdbf1/volumes"
Jul 26 16:01:45.161197 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:01:45.161182    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7103ed6e-5961-425a-8396-cca578e306b5" path="/var/lib/kubelet/pods/7103ed6e-5961-425a-8396-cca578e306b5/volumes"
Jul 26 16:02:06.219165 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.219085    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"]
Jul 26 16:02:06.219626 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.219310    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps" podUID="8acd2db9-c5da-4c5e-a30d-275031afe35e" containerName="maas-api" containerID="cri-o://a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c" gracePeriod=30
Jul 26 16:02:06.331132 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.331046    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"]
Jul 26 16:02:06.331539 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.331317    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln" podUID="c27d0d51-83ee-4098-b5e0-7fd7c4b2a498" containerName="payload-processing" containerID="cri-o://433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f" gracePeriod=30
Jul 26 16:02:06.480954 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.480878    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 16:02:06.555773 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.555361    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls\") pod \"8acd2db9-c5da-4c5e-a30d-275031afe35e\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") "
Jul 26 16:02:06.555773 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.555424    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtfc7\" (UniqueName: \"kubernetes.io/projected/8acd2db9-c5da-4c5e-a30d-275031afe35e-kube-api-access-xtfc7\") pod \"8acd2db9-c5da-4c5e-a30d-275031afe35e\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") "
Jul 26 16:02:06.555773 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.555532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acd2db9-c5da-4c5e-a30d-275031afe35e-openshift-service-ca\") pod \"8acd2db9-c5da-4c5e-a30d-275031afe35e\" (UID: \"8acd2db9-c5da-4c5e-a30d-275031afe35e\") "
Jul 26 16:02:06.556700 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.556488    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8acd2db9-c5da-4c5e-a30d-275031afe35e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8acd2db9-c5da-4c5e-a30d-275031afe35e" (UID: "8acd2db9-c5da-4c5e-a30d-275031afe35e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:02:06.559388 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.559351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8acd2db9-c5da-4c5e-a30d-275031afe35e-kube-api-access-xtfc7" (OuterVolumeSpecName: "kube-api-access-xtfc7") pod "8acd2db9-c5da-4c5e-a30d-275031afe35e" (UID: "8acd2db9-c5da-4c5e-a30d-275031afe35e"). InnerVolumeSpecName "kube-api-access-xtfc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:02:06.559624 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.559573    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8acd2db9-c5da-4c5e-a30d-275031afe35e" (UID: "8acd2db9-c5da-4c5e-a30d-275031afe35e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:02:06.595123 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.595101    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 16:02:06.657135 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.657108    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-plugins-config-volume\") pod \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\" (UID: \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\") "
Jul 26 16:02:06.657274 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.657143    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjh42\" (UniqueName: \"kubernetes.io/projected/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-kube-api-access-wjh42\") pod \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\" (UID: \"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498\") "
Jul 26 16:02:06.657323 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.657307    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8acd2db9-c5da-4c5e-a30d-275031afe35e-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:06.657323 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.657317    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtfc7\" (UniqueName: \"kubernetes.io/projected/8acd2db9-c5da-4c5e-a30d-275031afe35e-kube-api-access-xtfc7\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:06.657391 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.657327    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acd2db9-c5da-4c5e-a30d-275031afe35e-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:06.657544 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.657518    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c27d0d51-83ee-4098-b5e0-7fd7c4b2a498" (UID: "c27d0d51-83ee-4098-b5e0-7fd7c4b2a498"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:02:06.659247 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.659229    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-kube-api-access-wjh42" (OuterVolumeSpecName: "kube-api-access-wjh42") pod "c27d0d51-83ee-4098-b5e0-7fd7c4b2a498" (UID: "c27d0d51-83ee-4098-b5e0-7fd7c4b2a498"). InnerVolumeSpecName "kube-api-access-wjh42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:02:06.758680 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.758623    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:06.758680 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.758644    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjh42\" (UniqueName: \"kubernetes.io/projected/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498-kube-api-access-wjh42\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:06.837443 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.837414    2580 generic.go:356] "Generic (PLEG): container finished" podID="c27d0d51-83ee-4098-b5e0-7fd7c4b2a498" containerID="433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f" exitCode=0
Jul 26 16:02:06.837567 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.837453    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"
Jul 26 16:02:06.837567 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.837459    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln" event={"ID":"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498","Type":"ContainerDied","Data":"433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f"}
Jul 26 16:02:06.837567 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.837508    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln" event={"ID":"c27d0d51-83ee-4098-b5e0-7fd7c4b2a498","Type":"ContainerDied","Data":"de9e18d1f292682283100742d19218cc678ce40aab1833b9a5d900b2a20c6b1b"}
Jul 26 16:02:06.837567 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.837537    2580 scope.go:117] "RemoveContainer" containerID="433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f"
Jul 26 16:02:06.838796 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.838776    2580 generic.go:356] "Generic (PLEG): container finished" podID="8acd2db9-c5da-4c5e-a30d-275031afe35e" containerID="a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c" exitCode=0
Jul 26 16:02:06.838885 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.838809    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps" event={"ID":"8acd2db9-c5da-4c5e-a30d-275031afe35e","Type":"ContainerDied","Data":"a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c"}
Jul 26 16:02:06.838885 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.838841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps" event={"ID":"8acd2db9-c5da-4c5e-a30d-275031afe35e","Type":"ContainerDied","Data":"26704452daf5058ff59a73f36b2c146b963547da8daf38da6456c737eafa85c8"}
Jul 26 16:02:06.838885 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.838844    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"
Jul 26 16:02:06.847878 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.847858    2580 scope.go:117] "RemoveContainer" containerID="433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f"
Jul 26 16:02:06.848289 ip-10-0-132-129 kubenswrapper[2580]: E0726 16:02:06.848174    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f\": container with ID starting with 433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f not found: ID does not exist" containerID="433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f"
Jul 26 16:02:06.848289 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.848200    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f"} err="failed to get container status \"433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f\": rpc error: code = NotFound desc = could not find container \"433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f\": container with ID starting with 433aca4e95302bc11f4744c233da415ed14d23bd61edee017fdf5c589f14e46f not found: ID does not exist"
Jul 26 16:02:06.848289 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.848217    2580 scope.go:117] "RemoveContainer" containerID="a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c"
Jul 26 16:02:06.856058 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.856044    2580 scope.go:117] "RemoveContainer" containerID="a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c"
Jul 26 16:02:06.856277 ip-10-0-132-129 kubenswrapper[2580]: E0726 16:02:06.856259    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c\": container with ID starting with a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c not found: ID does not exist" containerID="a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c"
Jul 26 16:02:06.856316 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.856283    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c"} err="failed to get container status \"a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c\": rpc error: code = NotFound desc = could not find container \"a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c\": container with ID starting with a5fdcd82bec15283cec1022b885cc4022dfdef7c65a14556a5cf563ee183b90c not found: ID does not exist"
Jul 26 16:02:06.861373 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.861352    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"]
Jul 26 16:02:06.867304 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.867275    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-a20d61-57db9d8f74-nnhln"]
Jul 26 16:02:06.877734 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.877716    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"]
Jul 26 16:02:06.881552 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:06.881533    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a20d61-7d595bf88f-97rps"]
Jul 26 16:02:07.159681 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:07.159648    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8acd2db9-c5da-4c5e-a30d-275031afe35e" path="/var/lib/kubelet/pods/8acd2db9-c5da-4c5e-a30d-275031afe35e/volumes"
Jul 26 16:02:07.160086 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:07.160071    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c27d0d51-83ee-4098-b5e0-7fd7c4b2a498" path="/var/lib/kubelet/pods/c27d0d51-83ee-4098-b5e0-7fd7c4b2a498/volumes"
Jul 26 16:02:28.319537 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.319498    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"]
Jul 26 16:02:28.320034 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.319720    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm" podUID="ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" containerName="maas-api" containerID="cri-o://6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077" gracePeriod=30
Jul 26 16:02:28.383514 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.383480    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"]
Jul 26 16:02:28.383760 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.383710    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks" podUID="94f29777-1ce6-40b5-976b-79dd2dcdf938" containerName="payload-processing" containerID="cri-o://da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810" gracePeriod=30
Jul 26 16:02:28.625484 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.625460    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 16:02:28.661976 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.661954    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 16:02:28.741592 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.741566    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjw6w\" (UniqueName: \"kubernetes.io/projected/94f29777-1ce6-40b5-976b-79dd2dcdf938-kube-api-access-mjw6w\") pod \"94f29777-1ce6-40b5-976b-79dd2dcdf938\" (UID: \"94f29777-1ce6-40b5-976b-79dd2dcdf938\") "
Jul 26 16:02:28.741739 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.741651    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-openshift-service-ca\") pod \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") "
Jul 26 16:02:28.741739 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.741682    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94f29777-1ce6-40b5-976b-79dd2dcdf938-plugins-config-volume\") pod \"94f29777-1ce6-40b5-976b-79dd2dcdf938\" (UID: \"94f29777-1ce6-40b5-976b-79dd2dcdf938\") "
Jul 26 16:02:28.742002 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.741752    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrvrm\" (UniqueName: \"kubernetes.io/projected/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-kube-api-access-mrvrm\") pod \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") "
Jul 26 16:02:28.742002 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.741781    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls\") pod \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\" (UID: \"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854\") "
Jul 26 16:02:28.742106 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.742052    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" (UID: "ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:02:28.742166 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.742145    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94f29777-1ce6-40b5-976b-79dd2dcdf938-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94f29777-1ce6-40b5-976b-79dd2dcdf938" (UID: "94f29777-1ce6-40b5-976b-79dd2dcdf938"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:02:28.742229 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.742199    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-openshift-service-ca\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:28.743662 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.743641    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f29777-1ce6-40b5-976b-79dd2dcdf938-kube-api-access-mjw6w" (OuterVolumeSpecName: "kube-api-access-mjw6w") pod "94f29777-1ce6-40b5-976b-79dd2dcdf938" (UID: "94f29777-1ce6-40b5-976b-79dd2dcdf938"). InnerVolumeSpecName "kube-api-access-mjw6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:02:28.743823 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.743803    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" (UID: "ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:02:28.743903 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.743838    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-kube-api-access-mrvrm" (OuterVolumeSpecName: "kube-api-access-mrvrm") pod "ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" (UID: "ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854"). InnerVolumeSpecName "kube-api-access-mrvrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:02:28.843404 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.843336    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94f29777-1ce6-40b5-976b-79dd2dcdf938-plugins-config-volume\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:28.843404 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.843360    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrvrm\" (UniqueName: \"kubernetes.io/projected/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-kube-api-access-mrvrm\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:28.843404 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.843373    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854-maas-api-tls\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:28.843404 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.843385    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjw6w\" (UniqueName: \"kubernetes.io/projected/94f29777-1ce6-40b5-976b-79dd2dcdf938-kube-api-access-mjw6w\") on node \"ip-10-0-132-129.ec2.internal\" DevicePath \"\""
Jul 26 16:02:28.942101 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.942070    2580 generic.go:356] "Generic (PLEG): container finished" podID="94f29777-1ce6-40b5-976b-79dd2dcdf938" containerID="da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810" exitCode=0
Jul 26 16:02:28.942228 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.942113    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"
Jul 26 16:02:28.942228 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.942128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks" event={"ID":"94f29777-1ce6-40b5-976b-79dd2dcdf938","Type":"ContainerDied","Data":"da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810"}
Jul 26 16:02:28.942228 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.942183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks" event={"ID":"94f29777-1ce6-40b5-976b-79dd2dcdf938","Type":"ContainerDied","Data":"aeb382bf4a2a4210202f27aa97bd84cd71db3a688da646b6301c4df707896ddd"}
Jul 26 16:02:28.942228 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.942215    2580 scope.go:117] "RemoveContainer" containerID="da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810"
Jul 26 16:02:28.944087 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.943867    2580 generic.go:356] "Generic (PLEG): container finished" podID="ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" containerID="6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077" exitCode=0
Jul 26 16:02:28.944189 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.944121    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"
Jul 26 16:02:28.944189 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.944144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm" event={"ID":"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854","Type":"ContainerDied","Data":"6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077"}
Jul 26 16:02:28.944301 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.944225    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm" event={"ID":"ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854","Type":"ContainerDied","Data":"cd705ffd57ab9349b375efc2422cfae2bc11b73305a309afda7f8a2816cde27a"}
Jul 26 16:02:28.959442 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.959422    2580 scope.go:117] "RemoveContainer" containerID="da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810"
Jul 26 16:02:28.959700 ip-10-0-132-129 kubenswrapper[2580]: E0726 16:02:28.959681    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810\": container with ID starting with da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810 not found: ID does not exist" containerID="da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810"
Jul 26 16:02:28.959764 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.959709    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810"} err="failed to get container status \"da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810\": rpc error: code = NotFound desc = could not find container \"da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810\": container with ID starting with da5d3eb75b8c57440f135637edc6752f717c48f766ca2bacf5685cab2bf8b810 not found: ID does not exist"
Jul 26 16:02:28.959764 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.959726    2580 scope.go:117] "RemoveContainer" containerID="6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077"
Jul 26 16:02:28.966980 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.966961    2580 scope.go:117] "RemoveContainer" containerID="6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077"
Jul 26 16:02:28.967217 ip-10-0-132-129 kubenswrapper[2580]: E0726 16:02:28.967198    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077\": container with ID starting with 6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077 not found: ID does not exist" containerID="6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077"
Jul 26 16:02:28.967280 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.967222    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077"} err="failed to get container status \"6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077\": rpc error: code = NotFound desc = could not find container \"6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077\": container with ID starting with 6bc6d187f6541ae7f24ceca9c9f4970c5cc66b7f2240d0382ea7fe9459d02077 not found: ID does not exist"
Jul 26 16:02:28.971222 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.971189    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"]
Jul 26 16:02:28.972966 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.972945    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-60c814-7ff5d65c8b-fbzks"]
Jul 26 16:02:28.985499 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.985469    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"]
Jul 26 16:02:28.995135 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:28.995107    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-60c814-645d8478b8-57pbm"]
Jul 26 16:02:29.159867 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:29.159790    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f29777-1ce6-40b5-976b-79dd2dcdf938" path="/var/lib/kubelet/pods/94f29777-1ce6-40b5-976b-79dd2dcdf938/volumes"
Jul 26 16:02:29.160201 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:29.160187    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" path="/var/lib/kubelet/pods/ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854/volumes"
Jul 26 16:02:45.704647 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:45.704616    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ltzmk_ae7215db-95af-4feb-8794-2ff03f1a89a2/server/0.log"
Jul 26 16:02:46.056694 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:46.056661    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c55b8954b-fz6mb_33c00ffd-2a50-4b13-8264-e661f22fafc7/copy-manifests/0.log"
Jul 26 16:02:46.063299 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:46.063271    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c55b8954b-fz6mb_33c00ffd-2a50-4b13-8264-e661f22fafc7/manager/0.log"
Jul 26 16:02:46.519616 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:46.519530    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-586ff7d7cc-rtb98_f57fc9b4-0ae6-4d6d-a1fc-126c16f50132/maas-api/0.log"
Jul 26 16:02:49.371526 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:49.371497    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx_e1655dcf-c154-4baa-a6df-eea77f57bc63/istio-proxy/0.log"
Jul 26 16:02:49.485689 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:49.485658    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fxlpd_bbcd7451-4b20-4c10-b0c2-65e9c83785fb/discovery/0.log"
Jul 26 16:02:50.064949 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:50.064919    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cfcqq_186e7423-63a1-4de7-8017-bf79a30146b1/payload-processing/0.log"
Jul 26 16:02:50.174437 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:50.174405    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-556b4c7b7-tv4sv_4182d614-6a3c-4799-ab6c-8d497ff0b9ff/router/0.log"
Jul 26 16:02:50.505610 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:50.505539    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-7sdgt_135d54fe-9a13-4b1e-8d3f-59ba4c942574/main/0.log"
Jul 26 16:02:50.954115 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:50.954088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-79crx_b0b031e1-cbf1-46b6-aed2-859a2c4a967a/main/0.log"
Jul 26 16:02:59.362875 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:59.362843    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vsgfc_204ac6d8-66c3-429a-890c-c1765678937c/global-pull-secret-syncer/0.log"
Jul 26 16:02:59.448711 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:59.448680    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wtpbb_070513e9-0c74-4a2c-8425-949f30f92487/konnectivity-agent/0.log"
Jul 26 16:02:59.524089 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:02:59.524061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-129.ec2.internal_3c1159a049b4ab46ac6d83e420ef873c/haproxy/0.log"
Jul 26 16:03:06.784615 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:06.784582    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-p8sb7_ec7778f1-0e54-465d-90ce-784c357f45f5/cluster-monitoring-operator/0.log"
Jul 26 16:03:06.919652 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:06.919621    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c7f94c47d-bgzz6_b3061f31-44e2-4204-9db7-0489d9016057/metrics-server/0.log"
Jul 26 16:03:06.948710 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:06.948684    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-d6875_69ef4931-7bff-40f4-a487-cdea47583b31/monitoring-plugin/0.log"
Jul 26 16:03:07.163914 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.163871    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjffn_da28c14f-8e36-4f09-bd89-7b990215a019/node-exporter/0.log"
Jul 26 16:03:07.185100 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.185069    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjffn_da28c14f-8e36-4f09-bd89-7b990215a019/kube-rbac-proxy/0.log"
Jul 26 16:03:07.209954 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.209930    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjffn_da28c14f-8e36-4f09-bd89-7b990215a019/init-textfile/0.log"
Jul 26 16:03:07.622790 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.622759    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-kjx9x_8e40d687-dd9d-4421-b64e-a022589f34a0/prometheus-operator/0.log"
Jul 26 16:03:07.644631 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.644604    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-kjx9x_8e40d687-dd9d-4421-b64e-a022589f34a0/kube-rbac-proxy/0.log"
Jul 26 16:03:07.709615 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.709584    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d56c64d44-lvxc7_abad83fa-9507-433e-a41c-fa1cb592e391/telemeter-client/0.log"
Jul 26 16:03:07.727241 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.727214    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d56c64d44-lvxc7_abad83fa-9507-433e-a41c-fa1cb592e391/reload/0.log"
Jul 26 16:03:07.771488 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.771455    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d56c64d44-lvxc7_abad83fa-9507-433e-a41c-fa1cb592e391/kube-rbac-proxy/0.log"
Jul 26 16:03:07.799799 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.799768    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766575d4cd-g8sj4_e4a2c539-8c00-400b-9d90-07edf2ecf116/thanos-query/0.log"
Jul 26 16:03:07.820979 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.820952    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766575d4cd-g8sj4_e4a2c539-8c00-400b-9d90-07edf2ecf116/kube-rbac-proxy-web/0.log"
Jul 26 16:03:07.839524 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.839506    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766575d4cd-g8sj4_e4a2c539-8c00-400b-9d90-07edf2ecf116/kube-rbac-proxy/0.log"
Jul 26 16:03:07.856687 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.856665    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766575d4cd-g8sj4_e4a2c539-8c00-400b-9d90-07edf2ecf116/prom-label-proxy/0.log"
Jul 26 16:03:07.880153 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.880087    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766575d4cd-g8sj4_e4a2c539-8c00-400b-9d90-07edf2ecf116/kube-rbac-proxy-rules/0.log"
Jul 26 16:03:07.897849 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:07.897828    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-766575d4cd-g8sj4_e4a2c539-8c00-400b-9d90-07edf2ecf116/kube-rbac-proxy-metrics/0.log"
Jul 26 16:03:09.083512 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.083486    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-77dcx_21324742-b811-4978-95f6-b05e4608d1ca/networking-console-plugin/0.log"
Jul 26 16:03:09.721695 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.721659    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"]
Jul 26 16:03:09.722039 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722026    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad63453-b9b4-4a29-b336-da01961fdbf1" containerName="payload-processing"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722041    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad63453-b9b4-4a29-b336-da01961fdbf1" containerName="payload-processing"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722057    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" containerName="maas-api"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722062    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" containerName="maas-api"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722073    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8acd2db9-c5da-4c5e-a30d-275031afe35e" containerName="maas-api"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722079    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8acd2db9-c5da-4c5e-a30d-275031afe35e" containerName="maas-api"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722087    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722092    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722103    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7103ed6e-5961-425a-8396-cca578e306b5" containerName="payload-pre-processing"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722108    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7103ed6e-5961-425a-8396-cca578e306b5" containerName="payload-pre-processing"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722115    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy"
Jul 26 16:03:09.722116 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722120    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722127    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f29777-1ce6-40b5-976b-79dd2dcdf938" containerName="payload-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722133    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f29777-1ce6-40b5-976b-79dd2dcdf938" containerName="payload-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722144    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27d0d51-83ee-4098-b5e0-7fd7c4b2a498" containerName="payload-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722150    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27d0d51-83ee-4098-b5e0-7fd7c4b2a498" containerName="payload-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722156    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84bc0464-051d-4753-9fb8-b45a83628029" containerName="maas-api"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722162    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="84bc0464-051d-4753-9fb8-b45a83628029" containerName="maas-api"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722168    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="624dbf82-0683-4c33-8dd5-87c92d5aec1f" containerName="payload-pre-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722174    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="624dbf82-0683-4c33-8dd5-87c92d5aec1f" containerName="payload-pre-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722251    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8acd2db9-c5da-4c5e-a30d-275031afe35e" containerName="maas-api"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722260    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="94f29777-1ce6-40b5-976b-79dd2dcdf938" containerName="payload-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722268    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7103ed6e-5961-425a-8396-cca578e306b5" containerName="payload-pre-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722280    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="84bc0464-051d-4753-9fb8-b45a83628029" containerName="maas-api"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722286    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad63453-b9b4-4a29-b336-da01961fdbf1" containerName="payload-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722293    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722299    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="953ae785-1f07-4976-b01c-97a98f25f37e" containerName="istio-proxy"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722305    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="624dbf82-0683-4c33-8dd5-87c92d5aec1f" containerName="payload-pre-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722311    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27d0d51-83ee-4098-b5e0-7fd7c4b2a498" containerName="payload-processing"
Jul 26 16:03:09.722518 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.722316    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb4d4e8-63eb-4ef4-b00e-a66d8fbd7854" containerName="maas-api"
Jul 26 16:03:09.725484 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.725468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.728173 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.728110    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4ldhb\"/\"kube-root-ca.crt\""
Jul 26 16:03:09.728318 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.728232    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4ldhb\"/\"openshift-service-ca.crt\""
Jul 26 16:03:09.729418 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.729401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4ldhb\"/\"default-dockercfg-5tfm4\""
Jul 26 16:03:09.734824 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.734804    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"]
Jul 26 16:03:09.793884 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.793848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-proc\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.794067 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.793961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-sys\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.794067 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.793984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l7gl\" (UniqueName: \"kubernetes.io/projected/e6cad25c-fe05-4b44-9910-77f7a3951f78-kube-api-access-7l7gl\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.794067 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.794011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-lib-modules\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.794067 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.794056    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-podres\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895337 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-proc\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895503 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-sys\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895503 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-proc\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895503 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895429    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l7gl\" (UniqueName: \"kubernetes.io/projected/e6cad25c-fe05-4b44-9910-77f7a3951f78-kube-api-access-7l7gl\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895503 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-lib-modules\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895638 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895523    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-sys\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895638 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-podres\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895638 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-podres\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.895733 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.895647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6cad25c-fe05-4b44-9910-77f7a3951f78-lib-modules\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:09.903519 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:09.903493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l7gl\" (UniqueName: \"kubernetes.io/projected/e6cad25c-fe05-4b44-9910-77f7a3951f78-kube-api-access-7l7gl\") pod \"perf-node-gather-daemonset-gs65v\" (UID: \"e6cad25c-fe05-4b44-9910-77f7a3951f78\") " pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:10.035142 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:10.035115    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:10.177944 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:10.177913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"]
Jul 26 16:03:11.146065 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:11.146030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v" event={"ID":"e6cad25c-fe05-4b44-9910-77f7a3951f78","Type":"ContainerStarted","Data":"3fc341a54a34faeafea1a8a48b1b884b663b9aff058520b400d598a6b0c317e4"}
Jul 26 16:03:11.146240 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:11.146078    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v" event={"ID":"e6cad25c-fe05-4b44-9910-77f7a3951f78","Type":"ContainerStarted","Data":"524dd9ce158352b22f16c0e1c07e67d55c4a1843a4b14ad0e53f6671b6166df2"}
Jul 26 16:03:11.146240 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:11.146207    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:11.164696 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:11.164643    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v" podStartSLOduration=2.164624513 podStartE2EDuration="2.164624513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:03:11.16175816 +0000 UTC m=+3480.534807942" watchObservedRunningTime="2026-07-26 16:03:11.164624513 +0000 UTC m=+3480.537674292"
Jul 26 16:03:11.919385 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:11.919310    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dbp9s_fac29b5e-ef15-44d2-8dba-37d77bf721d0/dns/0.log"
Jul 26 16:03:11.937097 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:11.937076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dbp9s_fac29b5e-ef15-44d2-8dba-37d77bf721d0/kube-rbac-proxy/0.log"
Jul 26 16:03:12.055433 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:12.055405    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rf7vx_f740f8b6-ed75-43bf-8378-be860c4d5f3f/dns-node-resolver/0.log"
Jul 26 16:03:12.603678 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:12.603651    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f2dp7_91b8324b-a8e5-4108-b32b-2a378af644c0/node-ca/0.log"
Jul 26 16:03:13.542075 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:13.542047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx_e1655dcf-c154-4baa-a6df-eea77f57bc63/istio-proxy/0.log"
Jul 26 16:03:13.687273 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:13.687245    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fxlpd_bbcd7451-4b20-4c10-b0c2-65e9c83785fb/discovery/0.log"
Jul 26 16:03:13.842222 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:13.842149    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cfcqq_186e7423-63a1-4de7-8017-bf79a30146b1/payload-processing/0.log"
Jul 26 16:03:13.859971 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:13.859949    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-556b4c7b7-tv4sv_4182d614-6a3c-4799-ab6c-8d497ff0b9ff/router/0.log"
Jul 26 16:03:14.657563 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:14.657535    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27n6b_2a387e55-c562-43a9-a8dd-9df96a930415/serve-healthcheck-canary/0.log"
Jul 26 16:03:15.166734 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:15.166698    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mljx_d97c7d59-c3b6-4690-812c-f80b3368df12/kube-rbac-proxy/0.log"
Jul 26 16:03:15.183502 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:15.183481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mljx_d97c7d59-c3b6-4690-812c-f80b3368df12/exporter/0.log"
Jul 26 16:03:15.200016 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:15.199995    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mljx_d97c7d59-c3b6-4690-812c-f80b3368df12/extractor/0.log"
Jul 26 16:03:17.160947 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:17.160922    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4ldhb/perf-node-gather-daemonset-gs65v"
Jul 26 16:03:17.982948 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:17.982924    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ltzmk_ae7215db-95af-4feb-8794-2ff03f1a89a2/server/0.log"
Jul 26 16:03:18.222535 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:18.222508    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c55b8954b-fz6mb_33c00ffd-2a50-4b13-8264-e661f22fafc7/manager/0.log"
Jul 26 16:03:18.240280 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:18.240203    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c55b8954b-fz6mb_33c00ffd-2a50-4b13-8264-e661f22fafc7/copy-manifests/0.log"
Jul 26 16:03:19.728106 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:19.728078    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-694b8c44c9-tfm5l_e16de25c-4d50-4556-8cf8-950c62273ef0/manager/0.log"
Jul 26 16:03:20.604148 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:20.604115    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx_e1655dcf-c154-4baa-a6df-eea77f57bc63/istio-proxy/0.log"
Jul 26 16:03:20.739442 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:20.739406    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fxlpd_bbcd7451-4b20-4c10-b0c2-65e9c83785fb/discovery/0.log"
Jul 26 16:03:20.879332 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:20.879229    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cfcqq_186e7423-63a1-4de7-8017-bf79a30146b1/payload-processing/0.log"
Jul 26 16:03:20.895902 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:20.895863    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-556b4c7b7-tv4sv_4182d614-6a3c-4799-ab6c-8d497ff0b9ff/router/0.log"
Jul 26 16:03:22.334747 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:22.334717    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8xvxx_e1655dcf-c154-4baa-a6df-eea77f57bc63/istio-proxy/0.log"
Jul 26 16:03:22.476083 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:22.476051    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fxlpd_bbcd7451-4b20-4c10-b0c2-65e9c83785fb/discovery/0.log"
Jul 26 16:03:22.619434 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:22.619346    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-cfcqq_186e7423-63a1-4de7-8017-bf79a30146b1/payload-processing/0.log"
Jul 26 16:03:22.634125 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:22.634093    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-556b4c7b7-tv4sv_4182d614-6a3c-4799-ab6c-8d497ff0b9ff/router/0.log"
Jul 26 16:03:26.291092 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.291062    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gzmk_78c12206-8ddd-4769-9dc7-aa312103e616/kube-multus-additional-cni-plugins/0.log"
Jul 26 16:03:26.309019 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.308994    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gzmk_78c12206-8ddd-4769-9dc7-aa312103e616/egress-router-binary-copy/0.log"
Jul 26 16:03:26.325644 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.325622    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gzmk_78c12206-8ddd-4769-9dc7-aa312103e616/cni-plugins/0.log"
Jul 26 16:03:26.342447 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.342427    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gzmk_78c12206-8ddd-4769-9dc7-aa312103e616/bond-cni-plugin/0.log"
Jul 26 16:03:26.357810 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.357785    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gzmk_78c12206-8ddd-4769-9dc7-aa312103e616/routeoverride-cni/0.log"
Jul 26 16:03:26.373106 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.373092    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gzmk_78c12206-8ddd-4769-9dc7-aa312103e616/whereabouts-cni-bincopy/0.log"
Jul 26 16:03:26.389173 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.389154    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8gzmk_78c12206-8ddd-4769-9dc7-aa312103e616/whereabouts-cni/0.log"
Jul 26 16:03:26.501331 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.501310    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sjcs7_dd4dbd31-3f80-4ef0-89c0-5e1db15f077c/kube-multus/0.log"
Jul 26 16:03:26.564976 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.564904    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qb9cd_3f03e5fc-b967-47e5-a60e-22a7a78204c6/network-metrics-daemon/0.log"
Jul 26 16:03:26.580014 ip-10-0-132-129 kubenswrapper[2580]: I0726 16:03:26.579986    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qb9cd_3f03e5fc-b967-47e5-a60e-22a7a78204c6/kube-rbac-proxy/0.log"