Jul 31 22:00:07.934500 ip-10-0-139-36 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 22:00:08.305243 ip-10-0-139-36 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 22:00:08.305243 ip-10-0-139-36 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 22:00:08.305243 ip-10-0-139-36 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 22:00:08.305243 ip-10-0-139-36 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 22:00:08.305243 ip-10-0-139-36 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 22:00:08.306710 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.306625    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 22:00:08.311404 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311386    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 22:00:08.311404 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311403    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311407    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311410    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311415    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311418    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311421    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311424    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311427    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311429    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311432    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311435    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311438    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311440    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311443    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311445    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311451    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311454    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311456    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311459    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311461    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 22:00:08.311469 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311464    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311467    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311470    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311472    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311475    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311478    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311481    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311484    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311487    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311489    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311492    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311494    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311497    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311500    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311503    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311506    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311508    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311512    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311514    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311517    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 22:00:08.311952 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311519    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311522    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311525    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311528    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311530    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311533    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311535    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311538    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311541    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311543    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311546    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311548    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311551    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311553    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311557    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311560    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311563    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311565    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311568    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311570    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 22:00:08.312502 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311573    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311575    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311578    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311580    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311583    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311585    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311588    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311590    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311593    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311597    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311601    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311604    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311607    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311611    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311616    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311619    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311622    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311625    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311628    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 22:00:08.313115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311631    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311633    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311637    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311641    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311644    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311647    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311650    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311653    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311656    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311659    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311662    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311664    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311667    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311669    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311672    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311675    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311677    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311680    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.311682    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 22:00:08.313601 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312432    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312440    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312443    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312446    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312449    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312456    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312459    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312463    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312466    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312468    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312471    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312474    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312476    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312479    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312481    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312484    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312487    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312489    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312492    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312495    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 22:00:08.314055 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312497    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312500    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312503    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312506    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312509    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312512    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312515    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312517    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312520    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312522    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312526    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312529    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312532    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312535    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312537    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312540    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312544    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312548    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312551    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 22:00:08.314575 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312553    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312556    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312560    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312563    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312566    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312569    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312572    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312575    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312578    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312581    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312583    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312586    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312589    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312591    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312594    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312596    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312601    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312604    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312607    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 22:00:08.315062 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312610    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312612    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312615    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312618    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312622    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312624    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312627    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312630    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312632    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312635    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312638    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312641    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312643    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312646    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312649    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312652    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312654    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312657    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312660    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312663    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 22:00:08.315553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312665    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312668    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312670    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312673    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312675    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312678    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312680    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312683    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312686    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312688    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312690    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312693    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312695    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312698    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312700    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312702    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312705    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312707    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312710    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312712    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 22:00:08.316044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.312715    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313102    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313107    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313111    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313114    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313118    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313121    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313124    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313127    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313130    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313133    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313136    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313138    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313141    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313143    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313146    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313148    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313151    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313154    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313158    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 22:00:08.316576 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313162    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313164    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313168    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313170    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313187    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313190    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313193    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313196    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313199    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313202    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313205    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313208    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313210    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313213    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313217    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313220    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313224    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313227    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313234    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 22:00:08.317070 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313237    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313240    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313243    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313246    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313248    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313251    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313254    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313256    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313259    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313261    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313264    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313266    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313268    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313271    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313273    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313276    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313278    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313281    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313283    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 22:00:08.317554 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313286    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313289    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313291    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313294    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313296    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313298    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313301    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313304    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313307    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313309    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313313    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313315    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313319    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313323    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313326    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313329    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313332    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313335    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313337    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313340    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 22:00:08.318052 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313342    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313345    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313347    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313350    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313352    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313355    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313357    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313360    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313362    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313365    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313367    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313370    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313372    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313375    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313377    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313379    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313382    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313384    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313387    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313389    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 22:00:08.318593 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313391    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.313394    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313462    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313472    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313479    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313483    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313491    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313495    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313499    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313504    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313507    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313511    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313514    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313517    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313520    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313524    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313527    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313530    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313535    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313538    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313545    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313548    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313551    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313555    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 22:00:08.319125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313558    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313562    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313565    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313568    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313571    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313574    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313577    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313579    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313582    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313585    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313590    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313593    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313596    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313599    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313602    2577 flags.go:64] FLAG: --enable-server="true"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313606    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313613    2577 flags.go:64] FLAG: --event-burst="100"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313616    2577 flags.go:64] FLAG: --event-qps="50"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313619    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313622    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313625    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313629    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313631    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313634    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313637    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 31 22:00:08.319758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313640    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313644    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313648    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313651    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313654    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313657    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313660    2577 flags.go:64] FLAG: --feature-gates=""
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313664    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313667    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313670    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313673    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313676    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313679    2577 flags.go:64] FLAG: --help="false"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313684    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313687    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313690    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313693    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313696    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313700    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313703    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313706    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313708    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313711    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 22:00:08.320395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313715    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313718    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313720    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313723    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313726    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313729    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313732    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313735    2577 flags.go:64] FLAG: --lock-file=""
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313738    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313741    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313745    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313751    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313754    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313756    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313759    2577 flags.go:64] FLAG: --logging-format="text"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313762    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313765    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313768    2577 flags.go:64] FLAG: --manifest-url=""
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313771    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313775    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313778    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313782    2577 flags.go:64] FLAG: --max-pods="110"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313786    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313790    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313792    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 22:00:08.320997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313795    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313798    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313801    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313804    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313816    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313819    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313822    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313825    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313828    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313834    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313837    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313840    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313843    2577 flags.go:64] FLAG: --port="10250"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313846    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313849    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b895c606abeac9c"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313852    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313855    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313859    2577 flags.go:64] FLAG: --register-node="true"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313862    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313866    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313869    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313872    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313875    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313878    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313881    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 22:00:08.321624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313885    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313887    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313890    2577 flags.go:64] FLAG: --runonce="false"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313893    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313896    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313901    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313904    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313907    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313910    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313913    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313916    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313919    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313921    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313924    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313927    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313930    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313933    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313936    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313941    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313944    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313947    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313951    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313954    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313957    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313960    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 22:00:08.322247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313963    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313966    2577 flags.go:64] FLAG: --v="2"
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313970    2577 flags.go:64] FLAG: --version="false"
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313974    2577 flags.go:64] FLAG: --vmodule=""
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313978    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.313981    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314115    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314119    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314124    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314127    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314131    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314133    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314139    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314142    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314144    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314147    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314150    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314153    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314155    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314158    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314161    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 22:00:08.322908 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314163    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314166    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314168    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314183    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314188    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314191    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314195    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314197    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314200    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314203    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314207    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314210    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314212    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314215    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314218    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314220    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314223    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314226    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314228    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314231    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 22:00:08.323434 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314234    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314236    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314239    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314243    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314245    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314248    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314250    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314253    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314256    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314258    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314261    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314264    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314266    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314269    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314271    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314274    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314277    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314280    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314282    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 22:00:08.323945 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314285    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314287    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314290    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314294    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314296    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314299    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314301    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314304    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314307    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314309    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314312    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314315    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314317    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314320    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314323    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314325    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314329    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314331    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314334    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314337    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 22:00:08.324716 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314339    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314342    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314344    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314347    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314350    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314354    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314357    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314360    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314363    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314366    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314369    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314372    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314375    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314378    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314380    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314384    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314387    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314389    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314392    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 22:00:08.325477 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314395    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314397    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314400    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314402    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314405    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.314408    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.315061    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.321712    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.321729    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.321748    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.321754    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321811    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321816    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321819    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321822    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 22:00:08.326064 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321825    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321828    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321831    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321834    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321837    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321841    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321844    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321848    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321851    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321853    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321856    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321859    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321861    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321865    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321869    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321872    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321875    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321878    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321881    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 22:00:08.326494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321884    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321888    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321892    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321895    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321897    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321901    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321905    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321908    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321910    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321913    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321916    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321919    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321921    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321924    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321926    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321929    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321931    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321934    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321936    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321939    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 22:00:08.327061 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321941    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321944    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321947    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321949    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321952    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321954    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321957    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321959    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321962    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321965    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321967    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321969    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321972    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321974    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321977    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321979    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321982    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321985    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321988    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321991    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 22:00:08.327594 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321993    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321996    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.321998    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322001    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322004    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322006    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322008    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322011    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322013    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322016    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322018    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322021    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322023    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322026    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322029    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322031    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322034    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322037    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322039    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 22:00:08.328115 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322042    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322044    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322047    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322049    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322051    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322054    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322056    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322059    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322061    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322064    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322066    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322069    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322072    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322075    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322077    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322080    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 22:00:08.328821 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322082    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.322087    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322273    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322279    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322282    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322285    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322288    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322291    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322294    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322297    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322300    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322303    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322305    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322308    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 22:00:08.329492 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322311    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322313    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322316    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322319    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322322    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322325    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322327    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322330    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322333    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322335    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322338    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322341    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322343    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322346    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322349    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322351    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322354    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322357    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322359    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322362    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 22:00:08.329897 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322364    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322368    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322372    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322375    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322378    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322381    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322384    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322386    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322389    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322392    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322395    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322397    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322400    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322402    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322405    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322408    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322411    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322413    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322416    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322419    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 22:00:08.330746 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322422    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322425    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322427    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322429    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322432    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322435    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322437    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322441    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322444    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322447    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322450    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322453    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322456    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322458    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322461    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322463    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322466    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322468    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322471    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 22:00:08.331292 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322473    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322476    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322479    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322481    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322484    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322486    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322489    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322491    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322494    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322497    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322499    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322502    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322505    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322507    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322510    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322512    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322515    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322518    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322522    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322525    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 22:00:08.331756 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322527    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322530    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322532    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322537    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322539    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322542    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322544    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:08.322547    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.322552    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.322695    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.325544    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.326800    2577 server.go:1019] "Starting client certificate rotation"
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.326923    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 22:00:08.332287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.326967    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 22:00:08.332779 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.329418    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 22:00:08.333865 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.333628    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 22:00:08.346136 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.346116    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 31 22:00:08.348476 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.348459    2577 log.go:25] "Validated CRI v1 image API"
Jul 31 22:00:08.349383 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.349366    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 22:00:08.351853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.351819    2577 fs.go:135] Filesystem UUIDs: map[5d01bffa-249c-4938-8dd0-f6eabdb99ead:/dev/nvme0n1p3 6329a4f3-dfc7-4c80-b927-d3b23ace7ae4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 31 22:00:08.351931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.351852    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 22:00:08.354268 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.354239    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 22:00:08.359229 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.359105    2577 manager.go:216] Machine: {Timestamp:2026-07-31 22:00:08.356804712 +0000 UTC m=+0.309890934 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102123 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6f908b93bfba69f751e6f2b3992e SystemUUID:ec2a6f90-8b93-bfba-69f7-51e6f2b3992e BootID:1c388b89-dba5-4746-b22d-1b56dc3c4a4b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2a:00:7b:1b:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2a:00:7b:1b:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:1e:b9:1c:ff:d2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 22:00:08.359364 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.359234    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 22:00:08.359446 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.359427    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 22:00:08.362140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.362113    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 22:00:08.362318 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.362148    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 22:00:08.362944 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.362933    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 22:00:08.362984 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.362947    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 22:00:08.362984 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.362955    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 22:00:08.363638 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.363627    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 22:00:08.364458 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.364447    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 22:00:08.368481 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.368467    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 22:00:08.368613 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.368603    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 22:00:08.368651 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.368636    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 22:00:08.368651 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.368647    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 22:00:08.368724 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.368665    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 22:00:08.368724 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.368675    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 31 22:00:08.368724 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.368685    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 22:00:08.369154 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.369136    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 22:00:08.369295 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.369169    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 22:00:08.373523 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.373411    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 22:00:08.375384 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.375331    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 22:00:08.375384 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.375364    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 22:00:08.376456 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376442    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 22:00:08.376456 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376458    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376466    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376472    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376482    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376488    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376498    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376503    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376510    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376516    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376525    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 22:00:08.376557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.376531    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 22:00:08.377375 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.377359    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 22:00:08.377375 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.377373    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 22:00:08.378197 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.378169    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 22:00:08.378298 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.378173    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 22:00:08.381046 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.381027    2577 server.go:1268] "Started kubelet"
Jul 31 22:00:08.381163 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.381134    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 22:00:08.381518 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.381114    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 22:00:08.381518 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.381434    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 22:00:08.381903 ip-10-0-139-36 systemd[1]: Started Kubernetes Kubelet.
Jul 31 22:00:08.383003 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.382920    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 22:00:08.383641 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.383626    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 22:00:08.387045 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.387024    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 22:00:08.387497 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.387480    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 22:00:08.388456 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.387489    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-36.ec2.internal.18c77ecfd5809ad8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-36.ec2.internal,UID:ip-10-0-139-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-36.ec2.internal,},FirstTimestamp:2026-07-31 22:00:08.380996312 +0000 UTC m=+0.334082535,LastTimestamp:2026-07-31 22:00:08.380996312 +0000 UTC m=+0.334082535,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-36.ec2.internal,}"
Jul 31 22:00:08.388802 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.388788    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 22:00:08.388881 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.388801    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 22:00:08.388929 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.388896    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:08.389514 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.389492    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 22:00:08.389514 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.389494    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 22:00:08.389662 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.389530    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 22:00:08.389731 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.389716    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 22:00:08.389731 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.389730    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 22:00:08.389980 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.389962    2577 factory.go:153] Registering CRI-O factory
Jul 31 22:00:08.390040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.389983    2577 factory.go:223] Registration of the crio container factory successfully
Jul 31 22:00:08.390040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.390033    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 22:00:08.390128 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.390042    2577 factory.go:55] Registering systemd factory
Jul 31 22:00:08.390128 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.390048    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 31 22:00:08.390128 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.390071    2577 factory.go:103] Registering Raw factory
Jul 31 22:00:08.390128 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.390085    2577 manager.go:1196] Started watching for new ooms in manager
Jul 31 22:00:08.390818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.390801    2577 manager.go:349] Starting recovery of all containers
Jul 31 22:00:08.397322 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.397289    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 22:00:08.397495 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.397455    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 22:00:08.404173 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.404148    2577 manager.go:354] Recovery completed
Jul 31 22:00:08.409694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.409678    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 22:00:08.411780 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.411746    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 22:00:08.411871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.411801    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 22:00:08.411871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.411817    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientPID"
Jul 31 22:00:08.412373 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.412350    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 22:00:08.412373 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.412371    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 22:00:08.412534 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.412375    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 22:00:08.412534 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.412393    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 22:00:08.413129 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.413112    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 22:00:08.413192 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.413140    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 22:00:08.413192 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.413151    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientPID"
Jul 31 22:00:08.413724 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.413711    2577 policy_none.go:49] "None policy: Start"
Jul 31 22:00:08.413764 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.413728    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 22:00:08.413764 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.413741    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 22:00:08.414806 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.414795    2577 policy_none.go:47] "Start"
Jul 31 22:00:08.421531 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.421448    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-36.ec2.internal.18c77ecfd756550a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-36.ec2.internal,UID:ip-10-0-139-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-36.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-36.ec2.internal,},FirstTimestamp:2026-07-31 22:00:08.411780362 +0000 UTC m=+0.364866593,LastTimestamp:2026-07-31 22:00:08.411780362 +0000 UTC m=+0.364866593,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-36.ec2.internal,}"
Jul 31 22:00:08.431533 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.431443    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-36.ec2.internal.18c77ecfd756c39f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-36.ec2.internal,UID:ip-10-0-139-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-36.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-36.ec2.internal,},FirstTimestamp:2026-07-31 22:00:08.411808671 +0000 UTC m=+0.364894902,LastTimestamp:2026-07-31 22:00:08.411808671 +0000 UTC m=+0.364894902,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-36.ec2.internal,}"
Jul 31 22:00:08.441846 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.441763    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-36.ec2.internal.18c77ecfd756fa1b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-36.ec2.internal,UID:ip-10-0-139-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-36.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-36.ec2.internal,},FirstTimestamp:2026-07-31 22:00:08.411822619 +0000 UTC m=+0.364908849,LastTimestamp:2026-07-31 22:00:08.411822619 +0000 UTC m=+0.364908849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-36.ec2.internal,}"
Jul 31 22:00:08.441967 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.441827    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klg9w"
Jul 31 22:00:08.447894 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.447872    2577 manager.go:337] "Starting Device Plugin manager"
Jul 31 22:00:08.447990 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.447917    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 22:00:08.447990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.447930    2577 server.go:87] "Starting device plugin registration server"
Jul 31 22:00:08.448234 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.448221    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 22:00:08.448306 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.448236    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 22:00:08.448404 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.448384    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 22:00:08.448515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.448467    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 22:00:08.448515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.448476    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 22:00:08.449067 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.449048    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 22:00:08.449132 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.449095    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:08.451801 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.451780    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klg9w"
Jul 31 22:00:08.453686 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.453613    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-36.ec2.internal.18c77ecfd756550a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-36.ec2.internal.18c77ecfd756550a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-36.ec2.internal,UID:ip-10-0-139-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-36.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-36.ec2.internal,},FirstTimestamp:2026-07-31 22:00:08.411780362 +0000 UTC m=+0.364866593,LastTimestamp:2026-07-31 22:00:08.413128334 +0000 UTC m=+0.366214555,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-36.ec2.internal,}"
Jul 31 22:00:08.524371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.524323    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 22:00:08.525645 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.525624    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 22:00:08.525719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.525677    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 22:00:08.525719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.525713    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 22:00:08.525796 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.525762    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 22:00:08.528059 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.528037    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 22:00:08.549352 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.549315    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 22:00:08.550303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.550283    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 22:00:08.550364 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.550321    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 22:00:08.550364 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.550333    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientPID"
Jul 31 22:00:08.550364 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.550359    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.558305 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.558220    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.558305 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.558247    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-36.ec2.internal\": node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:08.579887 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.579859    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:08.626688 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.626651    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal"]
Jul 31 22:00:08.626854 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.626726    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 22:00:08.627727 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.627711    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 22:00:08.627810 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.627742    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 22:00:08.627810 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.627753    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientPID"
Jul 31 22:00:08.629111 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629098    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 22:00:08.629293 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.629337 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629311    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 22:00:08.629846 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629830    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 22:00:08.629958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629861    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 22:00:08.629958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629875    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientPID"
Jul 31 22:00:08.629958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629830    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 22:00:08.629958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629911    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 22:00:08.629958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.629934    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientPID"
Jul 31 22:00:08.631023 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.631005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.631114 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.631036    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 22:00:08.631988 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.631966    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 22:00:08.632101 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.631998    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 22:00:08.632101 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.632011    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeHasSufficientPID"
Jul 31 22:00:08.651885 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.651861    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-36.ec2.internal\" not found" node="ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.655628 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.655610    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-36.ec2.internal\" not found" node="ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.680739 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.680710    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:08.691521 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.691500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4ea314efcced055453abf2de2a06ad2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal\" (UID: \"a4ea314efcced055453abf2de2a06ad2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.691600 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.691527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4ea314efcced055453abf2de2a06ad2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal\" (UID: \"a4ea314efcced055453abf2de2a06ad2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.691600 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.691548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ca97dff295e0b083931c560215aedbae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-36.ec2.internal\" (UID: \"ca97dff295e0b083931c560215aedbae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.782888 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.782848    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:08.792711 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.792677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ca97dff295e0b083931c560215aedbae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-36.ec2.internal\" (UID: \"ca97dff295e0b083931c560215aedbae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.792781 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.792726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ca97dff295e0b083931c560215aedbae-config\") pod \"kube-apiserver-proxy-ip-10-0-139-36.ec2.internal\" (UID: \"ca97dff295e0b083931c560215aedbae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.792781 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.792773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4ea314efcced055453abf2de2a06ad2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal\" (UID: \"a4ea314efcced055453abf2de2a06ad2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.792859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.792808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4ea314efcced055453abf2de2a06ad2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal\" (UID: \"a4ea314efcced055453abf2de2a06ad2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.792859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.792836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4ea314efcced055453abf2de2a06ad2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal\" (UID: \"a4ea314efcced055453abf2de2a06ad2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.792939 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.792860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4ea314efcced055453abf2de2a06ad2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal\" (UID: \"a4ea314efcced055453abf2de2a06ad2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.883738 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.883670    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:08.958909 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.958872    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.959009 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:08.958872    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:08.984766 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:08.984611    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:09.090374 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.090325    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:09.196741 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.196652    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-36.ec2.internal\" not found"
Jul 31 22:00:09.258498 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.258466    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 22:00:09.291019 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.290982    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:09.326016 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.325985    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 22:00:09.326539 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.326156    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 22:00:09.326539 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.326208    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 22:00:09.326539 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.326214    2577 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://aebe771b1cbd140688342dcfda1d9508-310bf7d642b98222.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.139.36:32874->34.200.195.125:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:09.326539 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.326245    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:09.369228 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.369191    2577 apiserver.go:52] "Watching apiserver"
Jul 31 22:00:09.381399 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.381367    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 22:00:09.381773 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.381750    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-59z25","openshift-multus/multus-additional-cni-plugins-jnq2t","openshift-multus/multus-m72mv","openshift-multus/network-metrics-daemon-fj6jp","openshift-network-diagnostics/network-check-target-pg25b","openshift-network-operator/iptables-alerter-q5smv","openshift-ovn-kubernetes/ovnkube-node-ktsvj","kube-system/global-pull-secret-syncer-4wg9f","kube-system/konnectivity-agent-f6cwx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v","openshift-cluster-node-tuning-operator/tuned-2qx8m","openshift-dns/node-resolver-8hhq5"]
Jul 31 22:00:09.383381 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.383358    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.386700 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.386238    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mcjc6\""
Jul 31 22:00:09.387097 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.387071    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.388953 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.388932    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 22:00:09.389257 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.389224    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 22:00:09.389352 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.389338    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.389404 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.389391    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 22:00:09.390455 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.390439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:09.390522 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.390501    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:09.391531 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.391517    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:09.391583 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.391564    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:09.392617 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.392599    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.393827 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.393807    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.394991 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.394973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.395069 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.395036    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:09.396284 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.396267    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:09.398203 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.397718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.398203 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398125    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 22:00:09.398203 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398194    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 22:00:09.398411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg879\" (UniqueName: \"kubernetes.io/projected/69cf9430-e7db-4f38-b18c-16a078c2a8e6-kube-api-access-bg879\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.398411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-system-cni-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398303    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pdjhc\""
Jul 31 22:00:09.398411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-netns\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-daemon-config\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vbdd\" (UniqueName: \"kubernetes.io/projected/aa95e007-5c63-4e43-9244-15f7c5afa9a6-kube-api-access-4vbdd\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6467v\" (UniqueName: \"kubernetes.io/projected/866c0219-fa43-45eb-840c-63da62d71a0b-kube-api-access-6467v\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-socket-dir-parent\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-k8s-cni-cncf-io\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-kubelet\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-os-release\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398538    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-hostroot\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398585    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69cf9430-e7db-4f38-b18c-16a078c2a8e6-host\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-system-cni-dir\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69cf9430-e7db-4f38-b18c-16a078c2a8e6-serviceca\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-cni-bin\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-conf-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-multus-certs\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-cni-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.398713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-cnibin\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-cni-multus\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-etc-kubernetes\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-cnibin\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398885    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-os-release\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjhbb\" (UniqueName: \"kubernetes.io/projected/d379655c-3ced-4866-bfd2-efd0f5e8136f-kube-api-access-qjhbb\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398938    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.398957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa95e007-5c63-4e43-9244-15f7c5afa9a6-cni-binary-copy\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.399319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.399184    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q9wg2\""
Jul 31 22:00:09.399693 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.399411    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.400575 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.400559    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal"]
Jul 31 22:00:09.400646 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.400635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.401184 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.401168    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 22:00:09.401304 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.401290    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 22:00:09.401406 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.401391    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7wdq9\""
Jul 31 22:00:09.404284 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.404254    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 22:00:09.405112 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.405098    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 22:00:09.405419 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.405402    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 22:00:09.405461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.405402    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 22:00:09.405766 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.405747    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 22:00:09.405949 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.405929    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 22:00:09.406026 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.405972    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 22:00:09.406026 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.405985    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5f278\""
Jul 31 22:00:09.406140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.406038    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 22:00:09.406140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.406096    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 22:00:09.406140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.406121    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xjfr2\""
Jul 31 22:00:09.406359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.406345    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 22:00:09.406441 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.406424    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 22:00:09.406535 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.406517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 22:00:09.406963 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.406950    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 22:00:09.407047 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.407030    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 22:00:09.407106 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.407075    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c7g8f\""
Jul 31 22:00:09.408412 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.408398    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 22:00:09.408487 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.408440    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 22:00:09.409053 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.409036    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 22:00:09.409334 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.409321    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 22:00:09.413565 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.413539    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 22:00:09.413786 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.413769    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 22:00:09.413861 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.413774    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 22:00:09.413861 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.413795    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-csph2\""
Jul 31 22:00:09.416536 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.416520    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5mm64\""
Jul 31 22:00:09.422152 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.422136    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 22:00:09.444420 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.444395    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 22:00:09.456504 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.456426    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 21:55:08 +0000 UTC" deadline="2028-04-29 08:07:41.196117082 +0000 UTC"
Jul 31 22:00:09.456504 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.456454    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15298h7m31.739665987s"
Jul 31 22:00:09.490487 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.490448    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 22:00:09.499784 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.499758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovnkube-script-lib\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.499926 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.499791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-modprobe-d\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.499926 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.499816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysconfig\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.499926 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.499886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.500084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.499925    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa95e007-5c63-4e43-9244-15f7c5afa9a6-cni-binary-copy\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.500084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.499954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-node-log\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.500084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.499983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.500084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovn-node-metrics-cert\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.500084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-device-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.500084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-lib-modules\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.500084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af909ab0-696a-42dc-81c5-64497b5d4365-etc-tuned\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.500084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500082    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-systemd-units\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-hosts-file\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6467v\" (UniqueName: \"kubernetes.io/projected/866c0219-fa43-45eb-840c-63da62d71a0b-kube-api-access-6467v\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-socket-dir-parent\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdpzq\" (UniqueName: \"kubernetes.io/projected/af909ab0-696a-42dc-81c5-64497b5d4365-kube-api-access-jdpzq\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-os-release\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-os-release\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-socket-dir-parent\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.500457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-hostroot\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovnkube-config\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-hostroot\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa95e007-5c63-4e43-9244-15f7c5afa9a6-cni-binary-copy\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.500606    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-sys\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.500695    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs podName:d379655c-3ced-4866-bfd2-efd0f5e8136f nodeName:}" failed. No retries permitted until 2026-07-31 22:00:10.000650013 +0000 UTC m=+1.953736230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs") pod "network-metrics-daemon-fj6jp" (UID: "d379655c-3ced-4866-bfd2-efd0f5e8136f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af909ab0-696a-42dc-81c5-64497b5d4365-tmp\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-env-overrides\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-run\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69cf9430-e7db-4f38-b18c-16a078c2a8e6-serviceca\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.500910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-cni-bin\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500927    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-cni-bin\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.500990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78c70150-7620-4486-8af9-fbc5dbc105d6-iptables-alerter-script\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-host\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-cni-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-cni-multus\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-etc-kubernetes\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-var-lib-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4j9j\" (UniqueName: \"kubernetes.io/projected/67584753-a430-4922-a78b-60ff69d6248a-kube-api-access-d4j9j\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-etc-kubernetes\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-os-release\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-cni-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjhbb\" (UniqueName: \"kubernetes.io/projected/d379655c-3ced-4866-bfd2-efd0f5e8136f-kube-api-access-qjhbb\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-os-release\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.501788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06942b15-d888-43d5-8cea-f897b295ef40-dbus\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/69cf9430-e7db-4f38-b18c-16a078c2a8e6-serviceca\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-log-socket\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501338    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-cni-multus\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501464    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-952jl\" (UniqueName: \"kubernetes.io/projected/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-kube-api-access-952jl\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501490    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg879\" (UniqueName: \"kubernetes.io/projected/69cf9430-e7db-4f38-b18c-16a078c2a8e6-kube-api-access-bg879\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-system-cni-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-netns\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501619    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-daemon-config\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-system-cni-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vbdd\" (UniqueName: \"kubernetes.io/projected/aa95e007-5c63-4e43-9244-15f7c5afa9a6-kube-api-access-4vbdd\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-netns\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgxf\" (UniqueName: \"kubernetes.io/projected/78c70150-7620-4486-8af9-fbc5dbc105d6-kube-api-access-4bgxf\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-ovn\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.502606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-cni-bin\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-k8s-cni-cncf-io\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-kubelet\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501845    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-k8s-cni-cncf-io\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-kubelet\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-var-lib-kubelet\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vklf\" (UniqueName: \"kubernetes.io/projected/6bbfc883-7640-477b-9103-5db9c2c0d24c-kube-api-access-5vklf\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06942b15-d888-43d5-8cea-f897b295ef40-kubelet-config\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87a7ab77-269a-40cd-b07d-62c752cd4c8d-agent-certs\") pod \"konnectivity-agent-f6cwx\" (UID: \"87a7ab77-269a-40cd-b07d-62c752cd4c8d\") " pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.501977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-sys-fs\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysctl-d\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69cf9430-e7db-4f38-b18c-16a078c2a8e6-host\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-system-cni-dir\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/69cf9430-e7db-4f38-b18c-16a078c2a8e6-host\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-etc-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-daemon-config\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502198    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-system-cni-dir\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87a7ab77-269a-40cd-b07d-62c752cd4c8d-konnectivity-ca\") pod \"konnectivity-agent-f6cwx\" (UID: \"87a7ab77-269a-40cd-b07d-62c752cd4c8d\") " pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502228    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-systemd\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-conf-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-multus-certs\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-socket-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-var-lib-kubelet\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-multus-conf-dir\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-cnibin\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502328    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-host-run-multus-certs\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78c70150-7620-4486-8af9-fbc5dbc105d6-host-slash\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-slash\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-registration-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa95e007-5c63-4e43-9244-15f7c5afa9a6-cnibin\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-kubernetes\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysctl-conf\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-tmp-dir\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.503694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-cnibin\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.504202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.504202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-run-netns\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.504202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-systemd\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.504202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/866c0219-fa43-45eb-840c-63da62d71a0b-cnibin\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.504202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.502586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-cni-netd\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.504202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.503475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/866c0219-fa43-45eb-840c-63da62d71a0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.521629 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.521599    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 22:00:09.525124 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.525102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjhbb\" (UniqueName: \"kubernetes.io/projected/d379655c-3ced-4866-bfd2-efd0f5e8136f-kube-api-access-qjhbb\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:09.526891 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.526870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6467v\" (UniqueName: \"kubernetes.io/projected/866c0219-fa43-45eb-840c-63da62d71a0b-kube-api-access-6467v\") pod \"multus-additional-cni-plugins-jnq2t\" (UID: \"866c0219-fa43-45eb-840c-63da62d71a0b\") " pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.535798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.535767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg879\" (UniqueName: \"kubernetes.io/projected/69cf9430-e7db-4f38-b18c-16a078c2a8e6-kube-api-access-bg879\") pod \"node-ca-59z25\" (UID: \"69cf9430-e7db-4f38-b18c-16a078c2a8e6\") " pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.536072 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.536049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vbdd\" (UniqueName: \"kubernetes.io/projected/aa95e007-5c63-4e43-9244-15f7c5afa9a6-kube-api-access-4vbdd\") pod \"multus-m72mv\" (UID: \"aa95e007-5c63-4e43-9244-15f7c5afa9a6\") " pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.540924 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.540898    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5qlls"
Jul 31 22:00:09.575069 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.575035    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5qlls"
Jul 31 22:00:09.590420 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.590387    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ea314efcced055453abf2de2a06ad2.slice/crio-5cb1ee557ee34718e6afbcd45332031403b1e53c212e4498d7288aad56ebe7dd WatchSource:0}: Error finding container 5cb1ee557ee34718e6afbcd45332031403b1e53c212e4498d7288aad56ebe7dd: Status 404 returned error can't find the container with id 5cb1ee557ee34718e6afbcd45332031403b1e53c212e4498d7288aad56ebe7dd
Jul 31 22:00:09.594662 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.594645    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:00:09.603647 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-cni-netd\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.603769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovnkube-script-lib\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.603769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-modprobe-d\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.603769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603701    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysconfig\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.603769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-cni-netd\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.603769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-node-log\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysconfig\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovn-node-metrics-cert\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-node-log\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-modprobe-d\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-device-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-lib-modules\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603905    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af909ab0-696a-42dc-81c5-64497b5d4365-etc-tuned\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-systemd-units\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.603983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-hosts-file\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.604038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-lib-modules\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-systemd-units\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdpzq\" (UniqueName: \"kubernetes.io/projected/af909ab0-696a-42dc-81c5-64497b5d4365-kube-api-access-jdpzq\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovnkube-config\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-sys\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af909ab0-696a-42dc-81c5-64497b5d4365-tmp\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604135    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-hosts-file\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-sys\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-env-overrides\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-device-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-run\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604439    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-run\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604442    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovnkube-script-lib\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.605430 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.604543    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.604611    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret podName:06942b15-d888-43d5-8cea-f897b295ef40 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:10.104582392 +0000 UTC m=+2.057668617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret") pod "global-pull-secret-syncer-4wg9f" (UID: "06942b15-d888-43d5-8cea-f897b295ef40") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovnkube-config\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78c70150-7620-4486-8af9-fbc5dbc105d6-iptables-alerter-script\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-host\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-var-lib-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6bbfc883-7640-477b-9103-5db9c2c0d24c-env-overrides\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4j9j\" (UniqueName: \"kubernetes.io/projected/67584753-a430-4922-a78b-60ff69d6248a-kube-api-access-d4j9j\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06942b15-d888-43d5-8cea-f897b295ef40-dbus\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-host\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604835    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-var-lib-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-log-socket\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06942b15-d888-43d5-8cea-f897b295ef40-dbus\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.606371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-952jl\" (UniqueName: \"kubernetes.io/projected/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-kube-api-access-952jl\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgxf\" (UniqueName: \"kubernetes.io/projected/78c70150-7620-4486-8af9-fbc5dbc105d6-kube-api-access-4bgxf\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-ovn\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-cni-bin\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.604972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-log-socket\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-kubelet\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vklf\" (UniqueName: \"kubernetes.io/projected/6bbfc883-7640-477b-9103-5db9c2c0d24c-kube-api-access-5vklf\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-ovn\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06942b15-d888-43d5-8cea-f897b295ef40-kubelet-config\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605135    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-kubelet\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87a7ab77-269a-40cd-b07d-62c752cd4c8d-agent-certs\") pod \"konnectivity-agent-f6cwx\" (UID: \"87a7ab77-269a-40cd-b07d-62c752cd4c8d\") " pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-cni-bin\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-sys-fs\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysctl-d\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-etc-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87a7ab77-269a-40cd-b07d-62c752cd4c8d-konnectivity-ca\") pod \"konnectivity-agent-f6cwx\" (UID: \"87a7ab77-269a-40cd-b07d-62c752cd4c8d\") " pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-systemd\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-systemd\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-sys-fs\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysctl-d\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-etc-openvswitch\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-socket-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06942b15-d888-43d5-8cea-f897b295ef40-kubelet-config\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-var-lib-kubelet\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78c70150-7620-4486-8af9-fbc5dbc105d6-host-slash\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-slash\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-socket-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-registration-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-var-lib-kubelet\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67584753-a430-4922-a78b-60ff69d6248a-registration-dir\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-kubernetes\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.607807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/78c70150-7620-4486-8af9-fbc5dbc105d6-host-slash\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysctl-conf\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-tmp-dir\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-slash\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605816    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-run-netns\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-systemd\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.605944    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-run-systemd\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-kubernetes\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/78c70150-7620-4486-8af9-fbc5dbc105d6-iptables-alerter-script\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6bbfc883-7640-477b-9103-5db9c2c0d24c-host-run-netns\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/af909ab0-696a-42dc-81c5-64497b5d4365-etc-sysctl-conf\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-tmp-dir\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87a7ab77-269a-40cd-b07d-62c752cd4c8d-konnectivity-ca\") pod \"konnectivity-agent-f6cwx\" (UID: \"87a7ab77-269a-40cd-b07d-62c752cd4c8d\") " pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606796    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bbfc883-7640-477b-9103-5db9c2c0d24c-ovn-node-metrics-cert\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/af909ab0-696a-42dc-81c5-64497b5d4365-etc-tuned\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.606942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af909ab0-696a-42dc-81c5-64497b5d4365-tmp\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.608333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.607686    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87a7ab77-269a-40cd-b07d-62c752cd4c8d-agent-certs\") pod \"konnectivity-agent-f6cwx\" (UID: \"87a7ab77-269a-40cd-b07d-62c752cd4c8d\") " pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:09.636425 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.636392    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:09.636425 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.636421    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:09.636425 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.636433    2577 projected.go:196] Error preparing data for projected volume kube-api-access-t2p7r for pod openshift-network-diagnostics/network-check-target-pg25b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:09.636661 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:09.636495    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r podName:3b9a02d4-3e95-4222-ad58-8e3d93146bf2 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:10.136477178 +0000 UTC m=+2.089563391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t2p7r" (UniqueName: "kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r") pod "network-check-target-pg25b" (UID: "3b9a02d4-3e95-4222-ad58-8e3d93146bf2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:09.637573 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.637552    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-952jl\" (UniqueName: \"kubernetes.io/projected/0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8-kube-api-access-952jl\") pod \"node-resolver-8hhq5\" (UID: \"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8\") " pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.639057 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.639037    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdpzq\" (UniqueName: \"kubernetes.io/projected/af909ab0-696a-42dc-81c5-64497b5d4365-kube-api-access-jdpzq\") pod \"tuned-2qx8m\" (UID: \"af909ab0-696a-42dc-81c5-64497b5d4365\") " pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.643812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.643787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vklf\" (UniqueName: \"kubernetes.io/projected/6bbfc883-7640-477b-9103-5db9c2c0d24c-kube-api-access-5vklf\") pod \"ovnkube-node-ktsvj\" (UID: \"6bbfc883-7640-477b-9103-5db9c2c0d24c\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.649442 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.649418    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgxf\" (UniqueName: \"kubernetes.io/projected/78c70150-7620-4486-8af9-fbc5dbc105d6-kube-api-access-4bgxf\") pod \"iptables-alerter-q5smv\" (UID: \"78c70150-7620-4486-8af9-fbc5dbc105d6\") " pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.652832 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.652804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4j9j\" (UniqueName: \"kubernetes.io/projected/67584753-a430-4922-a78b-60ff69d6248a-kube-api-access-d4j9j\") pod \"aws-ebs-csi-driver-node-xfz7v\" (UID: \"67584753-a430-4922-a78b-60ff69d6248a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.710400 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.710302    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-59z25"
Jul 31 22:00:09.719035 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.719011    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69cf9430_e7db_4f38_b18c_16a078c2a8e6.slice/crio-db3f0a3edd9c9d58189489362e60a7b45cd528bcb9d70f197d97be102b0e6f2e WatchSource:0}: Error finding container db3f0a3edd9c9d58189489362e60a7b45cd528bcb9d70f197d97be102b0e6f2e: Status 404 returned error can't find the container with id db3f0a3edd9c9d58189489362e60a7b45cd528bcb9d70f197d97be102b0e6f2e
Jul 31 22:00:09.719844 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.719823    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 22:00:09.724505 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.724487    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jnq2t"
Jul 31 22:00:09.732669 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.732637    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866c0219_fa43_45eb_840c_63da62d71a0b.slice/crio-4d28cc184d47f64e16136585292070496f02f7982058e1abc4a6472a05fdcd93 WatchSource:0}: Error finding container 4d28cc184d47f64e16136585292070496f02f7982058e1abc4a6472a05fdcd93: Status 404 returned error can't find the container with id 4d28cc184d47f64e16136585292070496f02f7982058e1abc4a6472a05fdcd93
Jul 31 22:00:09.739906 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.739880    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m72mv"
Jul 31 22:00:09.744367 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.744344    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q5smv"
Jul 31 22:00:09.747693 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.747662    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca97dff295e0b083931c560215aedbae.slice/crio-4bb23619ac025e4e419c39a2fac9641da3b58201643fe4327d644802685bd6ee WatchSource:0}: Error finding container 4bb23619ac025e4e419c39a2fac9641da3b58201643fe4327d644802685bd6ee: Status 404 returned error can't find the container with id 4bb23619ac025e4e419c39a2fac9641da3b58201643fe4327d644802685bd6ee
Jul 31 22:00:09.748446 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.748418    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa95e007_5c63_4e43_9244_15f7c5afa9a6.slice/crio-780d4ef8eb6ed45b535d2e85597364e2de18b7e49127b650d82714bb6000205c WatchSource:0}: Error finding container 780d4ef8eb6ed45b535d2e85597364e2de18b7e49127b650d82714bb6000205c: Status 404 returned error can't find the container with id 780d4ef8eb6ed45b535d2e85597364e2de18b7e49127b650d82714bb6000205c
Jul 31 22:00:09.755375 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.755353    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c70150_7620_4486_8af9_fbc5dbc105d6.slice/crio-46c4b0eee077b5600b511361b12d3b9d7528543f53b00ccec667bb7d148b5ab3 WatchSource:0}: Error finding container 46c4b0eee077b5600b511361b12d3b9d7528543f53b00ccec667bb7d148b5ab3: Status 404 returned error can't find the container with id 46c4b0eee077b5600b511361b12d3b9d7528543f53b00ccec667bb7d148b5ab3
Jul 31 22:00:09.771492 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.771468    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:09.779482 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.779457    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bbfc883_7640_477b_9103_5db9c2c0d24c.slice/crio-97c173b8f213ff8a44867b6a8121a43fb8d6d7e9b440fc8b4a933291282d786b WatchSource:0}: Error finding container 97c173b8f213ff8a44867b6a8121a43fb8d6d7e9b440fc8b4a933291282d786b: Status 404 returned error can't find the container with id 97c173b8f213ff8a44867b6a8121a43fb8d6d7e9b440fc8b4a933291282d786b
Jul 31 22:00:09.791560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.791535    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:09.798677 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.798654    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v"
Jul 31 22:00:09.799440 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.799418    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a7ab77_269a_40cd_b07d_62c752cd4c8d.slice/crio-80ece78bda637eb020ceb2fd9ea481fd66fcb33b456963e6d20bef5d73446a0a WatchSource:0}: Error finding container 80ece78bda637eb020ceb2fd9ea481fd66fcb33b456963e6d20bef5d73446a0a: Status 404 returned error can't find the container with id 80ece78bda637eb020ceb2fd9ea481fd66fcb33b456963e6d20bef5d73446a0a
Jul 31 22:00:09.806029 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.806007    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67584753_a430_4922_a78b_60ff69d6248a.slice/crio-d7c91f389430d4306fd6f03a80ec8f713171f06dda9b58891d390ef2d3c9ef6b WatchSource:0}: Error finding container d7c91f389430d4306fd6f03a80ec8f713171f06dda9b58891d390ef2d3c9ef6b: Status 404 returned error can't find the container with id d7c91f389430d4306fd6f03a80ec8f713171f06dda9b58891d390ef2d3c9ef6b
Jul 31 22:00:09.833116 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.833076    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2qx8m"
Jul 31 22:00:09.841220 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.841193    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf909ab0_696a_42dc_81c5_64497b5d4365.slice/crio-a433cc3684359c14bfc1797958c2913060fb03fc407ca40bfa8ece9f8038e394 WatchSource:0}: Error finding container a433cc3684359c14bfc1797958c2913060fb03fc407ca40bfa8ece9f8038e394: Status 404 returned error can't find the container with id a433cc3684359c14bfc1797958c2913060fb03fc407ca40bfa8ece9f8038e394
Jul 31 22:00:09.843227 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.843210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8hhq5"
Jul 31 22:00:09.851631 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:09.851610    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6ab81a_9ae3_448c_afd3_0d3e7763b6c8.slice/crio-d04430493f1400e30e935ac13aea5a5af4f7975a76b2e4cf48bbd1796f73a443 WatchSource:0}: Error finding container d04430493f1400e30e935ac13aea5a5af4f7975a76b2e4cf48bbd1796f73a443: Status 404 returned error can't find the container with id d04430493f1400e30e935ac13aea5a5af4f7975a76b2e4cf48bbd1796f73a443
Jul 31 22:00:09.970656 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:09.970556    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 22:00:10.008737 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.008692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:10.008895 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.008845    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:10.008967 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.008914    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs podName:d379655c-3ced-4866-bfd2-efd0f5e8136f nodeName:}" failed. No retries permitted until 2026-07-31 22:00:11.008895466 +0000 UTC m=+2.961981679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs") pod "network-metrics-daemon-fj6jp" (UID: "d379655c-3ced-4866-bfd2-efd0f5e8136f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:10.109885 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.109852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:10.110056 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.109981    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:10.110056 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.110038    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret podName:06942b15-d888-43d5-8cea-f897b295ef40 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:11.110023618 +0000 UTC m=+3.063109827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret") pod "global-pull-secret-syncer-4wg9f" (UID: "06942b15-d888-43d5-8cea-f897b295ef40") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:10.210900 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.210847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:10.211157 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.211051    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:10.211157 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.211072    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:10.211157 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.211085    2577 projected.go:196] Error preparing data for projected volume kube-api-access-t2p7r for pod openshift-network-diagnostics/network-check-target-pg25b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:10.211157 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.211155    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r podName:3b9a02d4-3e95-4222-ad58-8e3d93146bf2 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:11.211129474 +0000 UTC m=+3.164215689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t2p7r" (UniqueName: "kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r") pod "network-check-target-pg25b" (UID: "3b9a02d4-3e95-4222-ad58-8e3d93146bf2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:10.374999 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.374915    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 22:00:10.526415 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.526379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:10.526608 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:10.526537    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:10.535786 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.535724    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal" event={"ID":"a4ea314efcced055453abf2de2a06ad2","Type":"ContainerStarted","Data":"5cb1ee557ee34718e6afbcd45332031403b1e53c212e4498d7288aad56ebe7dd"}
Jul 31 22:00:10.541430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.541377    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8hhq5" event={"ID":"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8","Type":"ContainerStarted","Data":"d04430493f1400e30e935ac13aea5a5af4f7975a76b2e4cf48bbd1796f73a443"}
Jul 31 22:00:10.549835 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.549753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v" event={"ID":"67584753-a430-4922-a78b-60ff69d6248a","Type":"ContainerStarted","Data":"d7c91f389430d4306fd6f03a80ec8f713171f06dda9b58891d390ef2d3c9ef6b"}
Jul 31 22:00:10.553192 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.553152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q5smv" event={"ID":"78c70150-7620-4486-8af9-fbc5dbc105d6","Type":"ContainerStarted","Data":"46c4b0eee077b5600b511361b12d3b9d7528543f53b00ccec667bb7d148b5ab3"}
Jul 31 22:00:10.555927 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.555893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2qx8m" event={"ID":"af909ab0-696a-42dc-81c5-64497b5d4365","Type":"ContainerStarted","Data":"a433cc3684359c14bfc1797958c2913060fb03fc407ca40bfa8ece9f8038e394"}
Jul 31 22:00:10.562324 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.562296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f6cwx" event={"ID":"87a7ab77-269a-40cd-b07d-62c752cd4c8d","Type":"ContainerStarted","Data":"80ece78bda637eb020ceb2fd9ea481fd66fcb33b456963e6d20bef5d73446a0a"}
Jul 31 22:00:10.564658 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.564630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"97c173b8f213ff8a44867b6a8121a43fb8d6d7e9b440fc8b4a933291282d786b"}
Jul 31 22:00:10.573340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.573311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m72mv" event={"ID":"aa95e007-5c63-4e43-9244-15f7c5afa9a6","Type":"ContainerStarted","Data":"780d4ef8eb6ed45b535d2e85597364e2de18b7e49127b650d82714bb6000205c"}
Jul 31 22:00:10.577173 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.577141    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:55:09 +0000 UTC" deadline="2027-12-31 20:55:15.360540763 +0000 UTC"
Jul 31 22:00:10.577289 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.577175    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12430h55m4.783370346s"
Jul 31 22:00:10.577822 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.577793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal" event={"ID":"ca97dff295e0b083931c560215aedbae","Type":"ContainerStarted","Data":"4bb23619ac025e4e419c39a2fac9641da3b58201643fe4327d644802685bd6ee"}
Jul 31 22:00:10.581819 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.581794    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerStarted","Data":"4d28cc184d47f64e16136585292070496f02f7982058e1abc4a6472a05fdcd93"}
Jul 31 22:00:10.591752 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:10.591724    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-59z25" event={"ID":"69cf9430-e7db-4f38-b18c-16a078c2a8e6","Type":"ContainerStarted","Data":"db3f0a3edd9c9d58189489362e60a7b45cd528bcb9d70f197d97be102b0e6f2e"}
Jul 31 22:00:11.017772 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:11.017729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:11.017996 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.017971    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:11.018074 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.018051    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs podName:d379655c-3ced-4866-bfd2-efd0f5e8136f nodeName:}" failed. No retries permitted until 2026-07-31 22:00:13.018032498 +0000 UTC m=+4.971118732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs") pod "network-metrics-daemon-fj6jp" (UID: "d379655c-3ced-4866-bfd2-efd0f5e8136f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:11.118685 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:11.118643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:11.118886 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.118827    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:11.118965 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.118906    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret podName:06942b15-d888-43d5-8cea-f897b295ef40 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:13.11888552 +0000 UTC m=+5.071971736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret") pod "global-pull-secret-syncer-4wg9f" (UID: "06942b15-d888-43d5-8cea-f897b295ef40") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:11.219932 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:11.219864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:11.220105 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.220080    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:11.220105 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.220101    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:11.220251 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.220115    2577 projected.go:196] Error preparing data for projected volume kube-api-access-t2p7r for pod openshift-network-diagnostics/network-check-target-pg25b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:11.220251 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.220180    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r podName:3b9a02d4-3e95-4222-ad58-8e3d93146bf2 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:13.220159937 +0000 UTC m=+5.173246168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t2p7r" (UniqueName: "kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r") pod "network-check-target-pg25b" (UID: "3b9a02d4-3e95-4222-ad58-8e3d93146bf2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:11.526470 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:11.526433    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:11.527003 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.526591    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:11.527003 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:11.526690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:11.527003 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:11.526765    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:11.577425 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:11.577367    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:55:09 +0000 UTC" deadline="2028-02-29 18:52:35.459682031 +0000 UTC"
Jul 31 22:00:11.577425 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:11.577422    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13868h52m23.882265084s"
Jul 31 22:00:11.824693 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:11.824609    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 22:00:12.529562 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:12.529490    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:12.530199 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:12.529640    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:13.037399 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:13.037176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:13.037607 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.037385    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:13.037607 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.037590    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs podName:d379655c-3ced-4866-bfd2-efd0f5e8136f nodeName:}" failed. No retries permitted until 2026-07-31 22:00:17.037565213 +0000 UTC m=+8.990651441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs") pod "network-metrics-daemon-fj6jp" (UID: "d379655c-3ced-4866-bfd2-efd0f5e8136f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:13.138854 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:13.138801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:13.139043 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.138955    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:13.139043 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.139022    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret podName:06942b15-d888-43d5-8cea-f897b295ef40 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:17.139003933 +0000 UTC m=+9.092090147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret") pod "global-pull-secret-syncer-4wg9f" (UID: "06942b15-d888-43d5-8cea-f897b295ef40") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:13.240085 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:13.240021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:13.240276 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.240235    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:13.240276 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.240266    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:13.240412 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.240281    2577 projected.go:196] Error preparing data for projected volume kube-api-access-t2p7r for pod openshift-network-diagnostics/network-check-target-pg25b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:13.240412 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.240350    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r podName:3b9a02d4-3e95-4222-ad58-8e3d93146bf2 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:17.240324719 +0000 UTC m=+9.193410942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t2p7r" (UniqueName: "kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r") pod "network-check-target-pg25b" (UID: "3b9a02d4-3e95-4222-ad58-8e3d93146bf2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:13.526975 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:13.526153    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:13.526975 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.526337    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:13.526975 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:13.526768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:13.526975 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:13.526873    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:14.527492 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:14.527457    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:14.528001 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:14.527607    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:15.526917 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:15.526378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:15.526917 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:15.526431    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:15.526917 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:15.526530    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:15.526917 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:15.526662    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:16.527940 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:16.527903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:16.528411 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:16.528059    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:17.073089 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:17.073047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:17.073301 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.073284    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:17.073372 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.073360    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs podName:d379655c-3ced-4866-bfd2-efd0f5e8136f nodeName:}" failed. No retries permitted until 2026-07-31 22:00:25.073339563 +0000 UTC m=+17.026425777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs") pod "network-metrics-daemon-fj6jp" (UID: "d379655c-3ced-4866-bfd2-efd0f5e8136f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:17.174522 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:17.173912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:17.174522 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.174081    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:17.174522 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.174149    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret podName:06942b15-d888-43d5-8cea-f897b295ef40 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:25.174127494 +0000 UTC m=+17.127213721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret") pod "global-pull-secret-syncer-4wg9f" (UID: "06942b15-d888-43d5-8cea-f897b295ef40") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:17.274439 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:17.274397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:17.274597 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.274560    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:17.274597 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.274584    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:17.274597 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.274597    2577 projected.go:196] Error preparing data for projected volume kube-api-access-t2p7r for pod openshift-network-diagnostics/network-check-target-pg25b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:17.274760 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.274653    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r podName:3b9a02d4-3e95-4222-ad58-8e3d93146bf2 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:25.274635181 +0000 UTC m=+17.227721404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t2p7r" (UniqueName: "kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r") pod "network-check-target-pg25b" (UID: "3b9a02d4-3e95-4222-ad58-8e3d93146bf2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:17.526305 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:17.525988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:17.526305 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.526132    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:17.526305 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:17.526238    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:17.526576 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:17.526358    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:18.528222 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:18.527728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:18.528222 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:18.527854    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:19.526882 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:19.526310    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:19.526882 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:19.526472    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:19.526882 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:19.526772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:19.526882 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:19.526845    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:20.526062 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:20.526030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:20.526539 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:20.526168    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:21.526320 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:21.526275    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:21.526682 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:21.526394    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:21.526682 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:21.526446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:21.526682 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:21.526538    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:22.526602 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:22.526561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:22.527100 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:22.526699    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:23.526357 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:23.526318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:23.526546 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:23.526318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:23.526546 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:23.526473    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:23.526546 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:23.526530    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:24.526858 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:24.526821    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:24.527329 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:24.526951    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:25.136840 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:25.136774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:25.137035 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.136946    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:25.137035 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.137019    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs podName:d379655c-3ced-4866-bfd2-efd0f5e8136f nodeName:}" failed. No retries permitted until 2026-07-31 22:00:41.136999618 +0000 UTC m=+33.090085824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs") pod "network-metrics-daemon-fj6jp" (UID: "d379655c-3ced-4866-bfd2-efd0f5e8136f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:25.237499 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:25.237455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:25.237665 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.237634    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:25.237727 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.237717    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret podName:06942b15-d888-43d5-8cea-f897b295ef40 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:41.237694082 +0000 UTC m=+33.190780307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret") pod "global-pull-secret-syncer-4wg9f" (UID: "06942b15-d888-43d5-8cea-f897b295ef40") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:25.338030 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:25.337995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:25.338222 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.338141    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:25.338222 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.338161    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:25.338222 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.338188    2577 projected.go:196] Error preparing data for projected volume kube-api-access-t2p7r for pod openshift-network-diagnostics/network-check-target-pg25b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:25.338329 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.338245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r podName:3b9a02d4-3e95-4222-ad58-8e3d93146bf2 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:41.338230586 +0000 UTC m=+33.291316793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t2p7r" (UniqueName: "kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r") pod "network-check-target-pg25b" (UID: "3b9a02d4-3e95-4222-ad58-8e3d93146bf2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:25.526910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:25.526832    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:25.526910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:25.526866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:25.527347 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.526975    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:25.527347 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:25.527083    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:26.526837 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:26.526782    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:26.527127 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:26.526943    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:27.526816 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:27.526780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:27.526816 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:27.526810    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:27.527069 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:27.526909    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:27.527069 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:27.527001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:28.526969 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:28.526934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:28.527437 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:28.527048    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:29.526131 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:29.526096    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:29.526317 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:29.526117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:29.526317 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:29.526249    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:29.526317 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:29.526270    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:30.528169 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.526032    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:30.528169 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:30.526558    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:30.642970 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.642945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2qx8m" event={"ID":"af909ab0-696a-42dc-81c5-64497b5d4365","Type":"ContainerStarted","Data":"fdd81b57993060d3003c15e0344fe2eda641f2250e95a24a88ced9a45ec204e5"}
Jul 31 22:00:30.644930 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.644842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f6cwx" event={"ID":"87a7ab77-269a-40cd-b07d-62c752cd4c8d","Type":"ContainerStarted","Data":"ae3d3d275e7e9550af8e16e68a5f4a750dceafa6af156adfd2a5b5a9f6ddec20"}
Jul 31 22:00:30.647611 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.647590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"8417feb1700cbc3f4f98b161d11db61281aa95ced1d09298687e35f38a161a4e"}
Jul 31 22:00:30.647717 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.647659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"fef7c8ff175bb66fbd73fa58652ccc694b7e985cb7129e90d67cccfaad623682"}
Jul 31 22:00:30.647717 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.647708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"419143d224c8ca8984112cb6dfd288b07a08a32d245622535f283ec0df7ca598"}
Jul 31 22:00:30.647892 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.647755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"692844b8a43224097163b82789205d6b477cdcc7dd456a73b9e7db528667659f"}
Jul 31 22:00:30.647892 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.647801    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"1a986cea9ad1e677d21524eac667ba50dc2c05c1105f7b0bcd4112182d347c52"}
Jul 31 22:00:30.648872 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.648848    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m72mv" event={"ID":"aa95e007-5c63-4e43-9244-15f7c5afa9a6","Type":"ContainerStarted","Data":"0b5b77fe2ed9bc98eae19c25eaf83dfdd3db990922c015bf96980d651f69159d"}
Jul 31 22:00:30.650143 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.650102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal" event={"ID":"ca97dff295e0b083931c560215aedbae","Type":"ContainerStarted","Data":"03534e325fed18d55c0e0f9ddaa22bd1f3a2830981aa2af836f4b98d4fbe01e7"}
Jul 31 22:00:30.651698 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.651671    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerStarted","Data":"6514b1ebfd666bf88fa15a9b318607a37482c72944362d741a04389d0d35017f"}
Jul 31 22:00:30.652864 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.652844    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-59z25" event={"ID":"69cf9430-e7db-4f38-b18c-16a078c2a8e6","Type":"ContainerStarted","Data":"0d65c4992f493bb323a404989a9ad7a7eec4774f7c0b808afee78315cc1fa96b"}
Jul 31 22:00:30.654080 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.654060    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal" event={"ID":"a4ea314efcced055453abf2de2a06ad2","Type":"ContainerStarted","Data":"2ee428f0687c9cec80f3ddac928c7b2ed9a7abd84ed295132b25650f9bf08d19"}
Jul 31 22:00:30.654291 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.654199    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"
Jul 31 22:00:30.656214 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.656191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8hhq5" event={"ID":"0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8","Type":"ContainerStarted","Data":"4c70ab82f4f89ff8322763c6864b149699fb699fdeba1e810caea52b5ab7fd41"}
Jul 31 22:00:30.657545 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.657525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v" event={"ID":"67584753-a430-4922-a78b-60ff69d6248a","Type":"ContainerStarted","Data":"1e233f7fb0ff9d6599a29bf7f801b7300fef7235b2d487b7af3fdd8703d7d9d9"}
Jul 31 22:00:30.664283 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.664235    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2qx8m" podStartSLOduration=1.540852971 podStartE2EDuration="21.664223826s" totalImagesPullingTime="20.123370855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:30.663647592 +0000 UTC m=+22.616733871" watchObservedRunningTime="2026-07-31 22:00:30.664223826 +0000 UTC m=+22.617310054"
Jul 31 22:00:30.670848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.670829    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 22:00:30.671881 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.671865    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal"]
Jul 31 22:00:30.712924 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.712881    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8hhq5" podStartSLOduration=1.600701401 podStartE2EDuration="21.712864407s" totalImagesPullingTime="20.112163006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:30.712837873 +0000 UTC m=+22.665924102" watchObservedRunningTime="2026-07-31 22:00:30.712864407 +0000 UTC m=+22.665950638"
Jul 31 22:00:30.713611 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.713549    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f6cwx" podStartSLOduration=1.549864935 podStartE2EDuration="21.713536811s" totalImagesPullingTime="20.163671876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:30.696963204 +0000 UTC m=+22.650049701" watchObservedRunningTime="2026-07-31 22:00:30.713536811 +0000 UTC m=+22.666623043"
Jul 31 22:00:30.729425 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.729244    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-36.ec2.internal" podStartSLOduration=21.7292266 podStartE2EDuration="21.7292266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:30.72861924 +0000 UTC m=+22.681705471" watchObservedRunningTime="2026-07-31 22:00:30.7292266 +0000 UTC m=+22.682312830"
Jul 31 22:00:30.770096 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.770053    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-59z25" podStartSLOduration=1.526934358 podStartE2EDuration="21.770039508s" totalImagesPullingTime="20.24310515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:30.747247004 +0000 UTC m=+22.700333228" watchObservedRunningTime="2026-07-31 22:00:30.770039508 +0000 UTC m=+22.723125734"
Jul 31 22:00:30.793386 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:30.793320    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m72mv" podStartSLOduration=1.396558163 podStartE2EDuration="21.793296311s" totalImagesPullingTime="20.396738148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:30.792554234 +0000 UTC m=+22.745640463" watchObservedRunningTime="2026-07-31 22:00:30.793296311 +0000 UTC m=+22.746382542"
Jul 31 22:00:31.526860 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.526681    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:31.527028 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.526707    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:31.527028 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:31.526975    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:31.527028 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:31.526998    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:31.662191 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.662133    2577 generic.go:356] "Generic (PLEG): container finished" podID="a4ea314efcced055453abf2de2a06ad2" containerID="2ee428f0687c9cec80f3ddac928c7b2ed9a7abd84ed295132b25650f9bf08d19" exitCode=0
Jul 31 22:00:31.662942 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.662248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal" event={"ID":"a4ea314efcced055453abf2de2a06ad2","Type":"ContainerDied","Data":"2ee428f0687c9cec80f3ddac928c7b2ed9a7abd84ed295132b25650f9bf08d19"}
Jul 31 22:00:31.662942 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.662293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal" event={"ID":"a4ea314efcced055453abf2de2a06ad2","Type":"ContainerStarted","Data":"d35ae42f5ac462aad6cfa6f5f287d7fcdcebf499d4928a71c7c9d586a3f9e12b"}
Jul 31 22:00:31.664226 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.664171    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q5smv" event={"ID":"78c70150-7620-4486-8af9-fbc5dbc105d6","Type":"ContainerStarted","Data":"c76b7beed0a5de02a1442dddbd113a14a054f4fb3dc67b21b0c003c1ef0ca8db"}
Jul 31 22:00:31.667674 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.667644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"7cbd9a9144cd541b207eef6dfa42161edd908c93c90339a86bf3d5574ac6ef90"}
Jul 31 22:00:31.669089 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.669063    2577 generic.go:356] "Generic (PLEG): container finished" podID="866c0219-fa43-45eb-840c-63da62d71a0b" containerID="6514b1ebfd666bf88fa15a9b318607a37482c72944362d741a04389d0d35017f" exitCode=0
Jul 31 22:00:31.669213 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.669192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerDied","Data":"6514b1ebfd666bf88fa15a9b318607a37482c72944362d741a04389d0d35017f"}
Jul 31 22:00:31.689248 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.689205    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-36.ec2.internal" podStartSLOduration=1.689191584 podStartE2EDuration="1.689191584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:31.689084579 +0000 UTC m=+23.642170812" watchObservedRunningTime="2026-07-31 22:00:31.689191584 +0000 UTC m=+23.642277804"
Jul 31 22:00:31.740668 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:31.740584    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q5smv" podStartSLOduration=2.533154889 podStartE2EDuration="22.740568883s" totalImagesPullingTime="20.207413994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:31.740546713 +0000 UTC m=+23.693632942" watchObservedRunningTime="2026-07-31 22:00:31.740568883 +0000 UTC m=+23.693655129"
Jul 31 22:00:32.404370 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:32.404339    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 22:00:32.463064 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:32.462942    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T22:00:32.404363559Z","UUID":"8cd3d6eb-eafe-4ff3-9a31-84212f981056","Handler":null,"Name":"","Endpoint":""}
Jul 31 22:00:32.464697 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:32.464676    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 22:00:32.464829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:32.464718    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 22:00:32.526665 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:32.526594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:32.526846 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:32.526700    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:32.674048 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:32.674007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v" event={"ID":"67584753-a430-4922-a78b-60ff69d6248a","Type":"ContainerStarted","Data":"259e398a0126b157ab45a565f303d6093561ed73f59fea980fbda38f7a4f5735"}
Jul 31 22:00:32.747285 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:32.747249    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:32.747875 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:32.747847    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:33.526721 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:33.526684    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:33.526721 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:33.526723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:33.526964 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:33.526811    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:33.526964 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:33.526906    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:33.680402 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:33.680364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"d087dee42a2593f19f3f3f2fc19715d11a4c3f1049ba67196dca74d65257f4f3"}
Jul 31 22:00:33.680833 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:33.680473    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:33.681011 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:33.680995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f6cwx"
Jul 31 22:00:34.526085 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:34.526042    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:34.526289 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:34.526206    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:34.685087 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:34.685055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v" event={"ID":"67584753-a430-4922-a78b-60ff69d6248a","Type":"ContainerStarted","Data":"a05b9513c82b340d67b1d0e730a179e2a616961b66cb8ee92d392f421f485c03"}
Jul 31 22:00:35.526808 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:35.526768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:35.526986 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:35.526825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:35.526986 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:35.526904    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:35.527074 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:35.527030    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:36.530049 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:36.529895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:36.530495 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:36.530140    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:36.693230 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:36.693192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" event={"ID":"6bbfc883-7640-477b-9103-5db9c2c0d24c","Type":"ContainerStarted","Data":"f05ac75ca17e5cc9a870b13f288784b24bb344af9fa8fa1a5bb922ec8079a09a"}
Jul 31 22:00:36.693479 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:36.693459    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:36.693589 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:36.693535    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:36.695030 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:36.695005    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerStarted","Data":"b02388e26c6dfd9f6c528717d133f25812595e7f661fc8c95e89283052558e1a"}
Jul 31 22:00:36.713213 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:36.713166    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:36.724643 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:36.724594    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj" podStartSLOduration=7.500356081 podStartE2EDuration="27.724579462s" totalImagesPullingTime="20.224223381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:36.722421449 +0000 UTC m=+28.675507678" watchObservedRunningTime="2026-07-31 22:00:36.724579462 +0000 UTC m=+28.677665690"
Jul 31 22:00:36.724834 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:36.724816    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfz7v" podStartSLOduration=4.522658996 podStartE2EDuration="27.72481039s" totalImagesPullingTime="23.202151394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:34.715048211 +0000 UTC m=+26.668134440" watchObservedRunningTime="2026-07-31 22:00:36.72481039 +0000 UTC m=+28.677896675"
Jul 31 22:00:37.526037 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:37.526005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:37.526286 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:37.526118    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:37.526286 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:37.526167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:37.526286 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:37.526274    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:37.701660 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:37.701622    2577 generic.go:356] "Generic (PLEG): container finished" podID="866c0219-fa43-45eb-840c-63da62d71a0b" containerID="b02388e26c6dfd9f6c528717d133f25812595e7f661fc8c95e89283052558e1a" exitCode=0
Jul 31 22:00:37.702312 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:37.701694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerDied","Data":"b02388e26c6dfd9f6c528717d133f25812595e7f661fc8c95e89283052558e1a"}
Jul 31 22:00:37.702312 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:37.702084    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:37.716687 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:37.716602    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:00:38.529098 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:38.529073    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:38.529270 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:38.529166    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:38.705772 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:38.705735    2577 generic.go:356] "Generic (PLEG): container finished" podID="866c0219-fa43-45eb-840c-63da62d71a0b" containerID="69c1fe3dc9779a6da80d9dcf5b5b81e65b6044627dc6ef284b383b94a4d86a27" exitCode=0
Jul 31 22:00:38.706280 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:38.705815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerDied","Data":"69c1fe3dc9779a6da80d9dcf5b5b81e65b6044627dc6ef284b383b94a4d86a27"}
Jul 31 22:00:39.526891 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:39.526860    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:39.527075 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:39.526860    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:39.527075 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:39.526951    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:39.527193 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:39.527069    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:40.526787 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:40.526742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:40.527293 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:40.526861    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:41.150937 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:41.150910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:41.151106 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.151033    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:41.151106 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.151088    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs podName:d379655c-3ced-4866-bfd2-efd0f5e8136f nodeName:}" failed. No retries permitted until 2026-07-31 22:01:13.15107114 +0000 UTC m=+65.104157350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs") pod "network-metrics-daemon-fj6jp" (UID: "d379655c-3ced-4866-bfd2-efd0f5e8136f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:41.251314 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:41.251286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:41.251458 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.251404    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:41.251458 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.251455    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret podName:06942b15-d888-43d5-8cea-f897b295ef40 nodeName:}" failed. No retries permitted until 2026-07-31 22:01:13.251441909 +0000 UTC m=+65.204528116 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret") pod "global-pull-secret-syncer-4wg9f" (UID: "06942b15-d888-43d5-8cea-f897b295ef40") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:41.351671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:41.351625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:41.351839 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.351795    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:41.351839 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.351814    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:41.351839 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.351828    2577 projected.go:196] Error preparing data for projected volume kube-api-access-t2p7r for pod openshift-network-diagnostics/network-check-target-pg25b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:41.351984 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.351896    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r podName:3b9a02d4-3e95-4222-ad58-8e3d93146bf2 nodeName:}" failed. No retries permitted until 2026-07-31 22:01:13.351880554 +0000 UTC m=+65.304966761 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t2p7r" (UniqueName: "kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r") pod "network-check-target-pg25b" (UID: "3b9a02d4-3e95-4222-ad58-8e3d93146bf2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:41.526295 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:41.526215    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:41.526295 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:41.526248    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:41.526466 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.526317    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:41.526466 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:41.526426    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:41.714267 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:41.714236    2577 generic.go:356] "Generic (PLEG): container finished" podID="866c0219-fa43-45eb-840c-63da62d71a0b" containerID="12357b2122a33e4b5ae76f7069a8c264f809622d441ae213373e9f9e52ace39b" exitCode=0
Jul 31 22:00:41.714635 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:41.714299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerDied","Data":"12357b2122a33e4b5ae76f7069a8c264f809622d441ae213373e9f9e52ace39b"}
Jul 31 22:00:42.526190 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:42.526155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:42.526360 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:42.526282    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:43.526033 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:43.525992    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:43.526033 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:43.526031    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:43.526733 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:43.526208    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:43.526733 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:43.526276    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:44.526779 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:44.526746    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:44.527261 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:44.526877    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:45.526243 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:45.526045    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:45.526444 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:45.526098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:45.526444 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:45.526327    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:45.526444 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:45.526410    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:46.526666 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:46.526557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:46.527014 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:46.526675    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:46.728782 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:46.728743    2577 generic.go:356] "Generic (PLEG): container finished" podID="866c0219-fa43-45eb-840c-63da62d71a0b" containerID="ca741cdf31d971b4ef630badd5526724b79209dbc4fb516105c437f1b29fdccf" exitCode=0
Jul 31 22:00:46.728960 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:46.728825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerDied","Data":"ca741cdf31d971b4ef630badd5526724b79209dbc4fb516105c437f1b29fdccf"}
Jul 31 22:00:47.527529 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:47.527489    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:47.528008 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:47.527631    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:47.528008 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:47.527497    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:47.528008 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:47.527792    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:47.733829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:47.733793    2577 generic.go:356] "Generic (PLEG): container finished" podID="866c0219-fa43-45eb-840c-63da62d71a0b" containerID="482234d447e0c68531ee6809035b7fc331a263c88c6fedd71c9b9ce1ab018aa4" exitCode=0
Jul 31 22:00:47.733994 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:47.733855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerDied","Data":"482234d447e0c68531ee6809035b7fc331a263c88c6fedd71c9b9ce1ab018aa4"}
Jul 31 22:00:48.527790 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.527761    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:48.528109 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:48.527883    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:48.714842 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.714806    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pg25b"]
Jul 31 22:00:48.715010 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.714928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:48.715071 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:48.715033    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:48.718399 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.718370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fj6jp"]
Jul 31 22:00:48.718551 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.718478    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:48.718614 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:48.718593    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:48.719090 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.719070    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4wg9f"]
Jul 31 22:00:48.741027 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.740961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:48.741027 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.741010    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" event={"ID":"866c0219-fa43-45eb-840c-63da62d71a0b","Type":"ContainerStarted","Data":"aca33203ef0822bbe43d08c564c2a49b48468f7eba1f1b015b08d79eaeaa828c"}
Jul 31 22:00:48.741279 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:48.741080    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:48.767852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:48.767596    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jnq2t" podStartSLOduration=7.289740624 podStartE2EDuration="39.767570433s" totalImagesPullingTime="32.477829809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:48.767116748 +0000 UTC m=+40.720202970" watchObservedRunningTime="2026-07-31 22:00:48.767570433 +0000 UTC m=+40.720656663"
Jul 31 22:00:50.526252 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:50.526222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:50.526623 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:50.526222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:50.526623 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:50.526330    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:50.526623 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:50.526232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:50.526623 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:50.526401    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:50.526623 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:50.526478    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:52.526290 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.526100    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:52.526658 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.526154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:52.526658 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:52.526368    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wg9f" podUID="06942b15-d888-43d5-8cea-f897b295ef40"
Jul 31 22:00:52.526658 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.526187    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:52.526658 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:52.526433    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fj6jp" podUID="d379655c-3ced-4866-bfd2-efd0f5e8136f"
Jul 31 22:00:52.526658 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:52.526537    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pg25b" podUID="3b9a02d4-3e95-4222-ad58-8e3d93146bf2"
Jul 31 22:00:52.830638 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.830608    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-36.ec2.internal" event="NodeReady"
Jul 31 22:00:52.830777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.830741    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 22:00:52.879944 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.879912    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qrftk"]
Jul 31 22:00:52.894581 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.894551    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qzbqb"]
Jul 31 22:00:52.894714 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.894673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:52.898538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.897584    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 22:00:52.898538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.898092    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jdkvx\""
Jul 31 22:00:52.898538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.898362    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 22:00:52.920816 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.920793    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qrftk"]
Jul 31 22:00:52.920952 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.920826    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzbqb"]
Jul 31 22:00:52.920952 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.920894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzbqb"
Jul 31 22:00:52.921067 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.920946    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x6zjb"]
Jul 31 22:00:52.923430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.923401    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 22:00:52.923736 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.923717    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 22:00:52.923859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.923790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w8lz5\""
Jul 31 22:00:52.924026 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.924011    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 22:00:52.944731 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.944707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x6zjb"]
Jul 31 22:00:52.944865 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.944833    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:52.947625 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.947606    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 22:00:52.947738 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.947640    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-snlzz\""
Jul 31 22:00:52.947861 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.947847    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 22:00:52.948056 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.948042    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 22:00:52.948256 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:52.948243    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 22:00:53.018881 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.018854    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6fc6479d-zh4zb"]
Jul 31 22:00:53.038746 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.038720    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6fc6479d-zh4zb"]
Jul 31 22:00:53.038860 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.038809    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.038962 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.038938    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.039161 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.039326 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edce7d28-6289-4102-8fa4-73cdc5dac0f7-metrics-tls\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.039451 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edce7d28-6289-4102-8fa4-73cdc5dac0f7-tmp-dir\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.039540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9sh\" (UniqueName: \"kubernetes.io/projected/edce7d28-6289-4102-8fa4-73cdc5dac0f7-kube-api-access-nc9sh\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.039540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee93c397-3f4a-4688-97ae-33f8f5be1d3a-cert\") pod \"ingress-canary-qzbqb\" (UID: \"ee93c397-3f4a-4688-97ae-33f8f5be1d3a\") " pod="openshift-ingress-canary/ingress-canary-qzbqb"
Jul 31 22:00:53.039540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtqvl\" (UniqueName: \"kubernetes.io/projected/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-kube-api-access-vtqvl\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.039715 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvssg\" (UniqueName: \"kubernetes.io/projected/ee93c397-3f4a-4688-97ae-33f8f5be1d3a-kube-api-access-zvssg\") pod \"ingress-canary-qzbqb\" (UID: \"ee93c397-3f4a-4688-97ae-33f8f5be1d3a\") " pod="openshift-ingress-canary/ingress-canary-qzbqb"
Jul 31 22:00:53.039715 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edce7d28-6289-4102-8fa4-73cdc5dac0f7-config-volume\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.039715 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-crio-socket\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.039715 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.039640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-data-volume\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.041462 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.041442    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 22:00:53.041559 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.041486    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 22:00:53.041559 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.041551    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 22:00:53.041663 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.041581    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 22:00:53.041859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.041840    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 22:00:53.041945 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.041881    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 22:00:53.041945 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.041890    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 22:00:53.041945 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.041847    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-prjdv\""
Jul 31 22:00:53.140750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrngh\" (UniqueName: \"kubernetes.io/projected/6adb9307-e39b-4d7b-80d4-957a27fb3e01-kube-api-access-qrngh\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.140750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.140750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.140750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-serving-cert\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.141066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edce7d28-6289-4102-8fa4-73cdc5dac0f7-metrics-tls\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.141066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edce7d28-6289-4102-8fa4-73cdc5dac0f7-tmp-dir\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.141066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9sh\" (UniqueName: \"kubernetes.io/projected/edce7d28-6289-4102-8fa4-73cdc5dac0f7-kube-api-access-nc9sh\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.141066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee93c397-3f4a-4688-97ae-33f8f5be1d3a-cert\") pod \"ingress-canary-qzbqb\" (UID: \"ee93c397-3f4a-4688-97ae-33f8f5be1d3a\") " pod="openshift-ingress-canary/ingress-canary-qzbqb"
Jul 31 22:00:53.141066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.140990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-oauth-config\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.141066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtqvl\" (UniqueName: \"kubernetes.io/projected/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-kube-api-access-vtqvl\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.141066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-service-ca\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.141429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-config\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.141429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvssg\" (UniqueName: \"kubernetes.io/projected/ee93c397-3f4a-4688-97ae-33f8f5be1d3a-kube-api-access-zvssg\") pod \"ingress-canary-qzbqb\" (UID: \"ee93c397-3f4a-4688-97ae-33f8f5be1d3a\") " pod="openshift-ingress-canary/ingress-canary-qzbqb"
Jul 31 22:00:53.141429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edce7d28-6289-4102-8fa4-73cdc5dac0f7-config-volume\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.141429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-crio-socket\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.141429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-data-volume\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.141429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-oauth-serving-cert\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.141429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edce7d28-6289-4102-8fa4-73cdc5dac0f7-tmp-dir\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.141725 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.141725 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141686    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-crio-socket\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.141725 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141717    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-data-volume\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.141855 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.141777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edce7d28-6289-4102-8fa4-73cdc5dac0f7-config-volume\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.144910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.144879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.144910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.144900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee93c397-3f4a-4688-97ae-33f8f5be1d3a-cert\") pod \"ingress-canary-qzbqb\" (UID: \"ee93c397-3f4a-4688-97ae-33f8f5be1d3a\") " pod="openshift-ingress-canary/ingress-canary-qzbqb"
Jul 31 22:00:53.145060 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.144879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edce7d28-6289-4102-8fa4-73cdc5dac0f7-metrics-tls\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.149212 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.149191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtqvl\" (UniqueName: \"kubernetes.io/projected/7e0435e4-3a55-4a9a-be11-18ae6a977ed8-kube-api-access-vtqvl\") pod \"insights-runtime-extractor-x6zjb\" (UID: \"7e0435e4-3a55-4a9a-be11-18ae6a977ed8\") " pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.149515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.149492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvssg\" (UniqueName: \"kubernetes.io/projected/ee93c397-3f4a-4688-97ae-33f8f5be1d3a-kube-api-access-zvssg\") pod \"ingress-canary-qzbqb\" (UID: \"ee93c397-3f4a-4688-97ae-33f8f5be1d3a\") " pod="openshift-ingress-canary/ingress-canary-qzbqb"
Jul 31 22:00:53.150160 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.150131    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9sh\" (UniqueName: \"kubernetes.io/projected/edce7d28-6289-4102-8fa4-73cdc5dac0f7-kube-api-access-nc9sh\") pod \"dns-default-qrftk\" (UID: \"edce7d28-6289-4102-8fa4-73cdc5dac0f7\") " pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.205149 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.205119    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:53.229289 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.229260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qzbqb"
Jul 31 22:00:53.241829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.241806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-serving-cert\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.241943 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.241843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-oauth-config\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.241943 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.241863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-service-ca\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.241943 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.241880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-config\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.242097 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.242024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-oauth-serving-cert\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.242151 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.242108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrngh\" (UniqueName: \"kubernetes.io/projected/6adb9307-e39b-4d7b-80d4-957a27fb3e01-kube-api-access-qrngh\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.242616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.242581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-config\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.242714 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.242640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-service-ca\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.242913 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.242895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-oauth-serving-cert\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.244263 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.244241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-oauth-config\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.244354 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.244341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-serving-cert\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.251514 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.251495    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrngh\" (UniqueName: \"kubernetes.io/projected/6adb9307-e39b-4d7b-80d4-957a27fb3e01-kube-api-access-qrngh\") pod \"console-c6fc6479d-zh4zb\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") " pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.253277 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.253253    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x6zjb"
Jul 31 22:00:53.347571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.347516    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:00:53.442761 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.442726    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qzbqb"]
Jul 31 22:00:53.444760 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.444701    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qrftk"]
Jul 31 22:00:53.447626 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:53.447596    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee93c397_3f4a_4688_97ae_33f8f5be1d3a.slice/crio-f10fb78921375a9b7cfcb32c39f4ec27eace12f73f23292f8c321b613c195e6a WatchSource:0}: Error finding container f10fb78921375a9b7cfcb32c39f4ec27eace12f73f23292f8c321b613c195e6a: Status 404 returned error can't find the container with id f10fb78921375a9b7cfcb32c39f4ec27eace12f73f23292f8c321b613c195e6a
Jul 31 22:00:53.448421 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:53.448397    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedce7d28_6289_4102_8fa4_73cdc5dac0f7.slice/crio-4e7294ac01dc2a25f9fcadec9fda47951085e962d461a94777ed0441287d7c2b WatchSource:0}: Error finding container 4e7294ac01dc2a25f9fcadec9fda47951085e962d461a94777ed0441287d7c2b: Status 404 returned error can't find the container with id 4e7294ac01dc2a25f9fcadec9fda47951085e962d461a94777ed0441287d7c2b
Jul 31 22:00:53.456257 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.456231    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x6zjb"]
Jul 31 22:00:53.459677 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:53.459654    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0435e4_3a55_4a9a_be11_18ae6a977ed8.slice/crio-dbf5afb55a7c516002feb5aacc4ec16c28aa44b7b859d2f12ee55f40a41f6338 WatchSource:0}: Error finding container dbf5afb55a7c516002feb5aacc4ec16c28aa44b7b859d2f12ee55f40a41f6338: Status 404 returned error can't find the container with id dbf5afb55a7c516002feb5aacc4ec16c28aa44b7b859d2f12ee55f40a41f6338
Jul 31 22:00:53.512056 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.511854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6fc6479d-zh4zb"]
Jul 31 22:00:53.514698 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:53.514668    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6adb9307_e39b_4d7b_80d4_957a27fb3e01.slice/crio-f451eab425b8070db3c074c490142fa7940e9921321d25fee4df01d3b555561f WatchSource:0}: Error finding container f451eab425b8070db3c074c490142fa7940e9921321d25fee4df01d3b555561f: Status 404 returned error can't find the container with id f451eab425b8070db3c074c490142fa7940e9921321d25fee4df01d3b555561f
Jul 31 22:00:53.756972 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.756864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6fc6479d-zh4zb" event={"ID":"6adb9307-e39b-4d7b-80d4-957a27fb3e01","Type":"ContainerStarted","Data":"f451eab425b8070db3c074c490142fa7940e9921321d25fee4df01d3b555561f"}
Jul 31 22:00:53.758330 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.758306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6zjb" event={"ID":"7e0435e4-3a55-4a9a-be11-18ae6a977ed8","Type":"ContainerStarted","Data":"e28e1c5daada42ba42530a9e27d5784a627689ab1b04ff65382c42ed0b8ad8fc"}
Jul 31 22:00:53.758443 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.758356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6zjb" event={"ID":"7e0435e4-3a55-4a9a-be11-18ae6a977ed8","Type":"ContainerStarted","Data":"dbf5afb55a7c516002feb5aacc4ec16c28aa44b7b859d2f12ee55f40a41f6338"}
Jul 31 22:00:53.759322 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.759302    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzbqb" event={"ID":"ee93c397-3f4a-4688-97ae-33f8f5be1d3a","Type":"ContainerStarted","Data":"f10fb78921375a9b7cfcb32c39f4ec27eace12f73f23292f8c321b613c195e6a"}
Jul 31 22:00:53.760276 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:53.760252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qrftk" event={"ID":"edce7d28-6289-4102-8fa4-73cdc5dac0f7","Type":"ContainerStarted","Data":"4e7294ac01dc2a25f9fcadec9fda47951085e962d461a94777ed0441287d7c2b"}
Jul 31 22:00:54.526434 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.526403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:00:54.526738 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.526404    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:00:54.526738 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.526525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:00:54.530894 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.530587    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nslhh\""
Jul 31 22:00:54.530894 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.530669    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sb6cn\""
Jul 31 22:00:54.530894 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.530695    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 22:00:54.530894 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.530781    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 22:00:54.531210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.530904    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 22:00:54.531210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:54.530994    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 22:00:56.508950 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.508918    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"]
Jul 31 22:00:56.529969 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.529935    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.536557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.536528    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"]
Jul 31 22:00:56.538211 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.538157    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 31 22:00:56.540641 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.540622    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 31 22:00:56.540641 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.540634    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gkrrd\""
Jul 31 22:00:56.541885 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.541823    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 22:00:56.541885 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.541823    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 22:00:56.542111 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.542094    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 22:00:56.590676 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.590641    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tvbm5"]
Jul 31 22:00:56.601852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.601824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.604370 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.604342    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 22:00:56.604823 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.604804    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 22:00:56.605103 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.605026    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c8br7\""
Jul 31 22:00:56.605103 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.605092    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 22:00:56.671456 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.671422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.671456 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.671461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.671684 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.671480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjmn\" (UniqueName: \"kubernetes.io/projected/f40099ec-1860-444b-a4f6-bda5fad32aca-kube-api-access-czjmn\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.671684 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.671603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f40099ec-1860-444b-a4f6-bda5fad32aca-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.772067 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.771986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfhn\" (UniqueName: \"kubernetes.io/projected/32c547b0-702f-49d5-81f2-c05352d1702a-kube-api-access-4dfhn\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772067 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-root\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772067 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772043    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c547b0-702f-49d5-81f2-c05352d1702a-metrics-client-ca\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.772359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-sys\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-textfile\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-tls\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772596 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772596 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f40099ec-1860-444b-a4f6-bda5fad32aca-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.772596 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.772596 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjmn\" (UniqueName: \"kubernetes.io/projected/f40099ec-1860-444b-a4f6-bda5fad32aca-kube-api-access-czjmn\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.772596 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.772499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-wtmp\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.772596 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:56.772543    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 31 22:00:56.772893 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:56.772602    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls podName:f40099ec-1860-444b-a4f6-bda5fad32aca nodeName:}" failed. No retries permitted until 2026-07-31 22:00:57.272583667 +0000 UTC m=+49.225669874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-nrjzd" (UID: "f40099ec-1860-444b-a4f6-bda5fad32aca") : secret "openshift-state-metrics-tls" not found
Jul 31 22:00:56.773134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.773111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f40099ec-1860-444b-a4f6-bda5fad32aca-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.776153 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.776123    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.784140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.784121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjmn\" (UniqueName: \"kubernetes.io/projected/f40099ec-1860-444b-a4f6-bda5fad32aca-kube-api-access-czjmn\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:56.873523 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-tls\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873701 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873701 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-wtmp\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873701 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:56.873625    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 31 22:00:56.873701 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfhn\" (UniqueName: \"kubernetes.io/projected/32c547b0-702f-49d5-81f2-c05352d1702a-kube-api-access-4dfhn\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873701 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:56.873691    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-tls podName:32c547b0-702f-49d5-81f2-c05352d1702a nodeName:}" failed. No retries permitted until 2026-07-31 22:00:57.373669765 +0000 UTC m=+49.326755992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-tls") pod "node-exporter-tvbm5" (UID: "32c547b0-702f-49d5-81f2-c05352d1702a") : secret "node-exporter-tls" not found
Jul 31 22:00:56.873964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-root\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c547b0-702f-49d5-81f2-c05352d1702a-metrics-client-ca\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-sys\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-root\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-textfile\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.873964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-wtmp\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.874303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.873986    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c547b0-702f-49d5-81f2-c05352d1702a-sys\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.874303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.874261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-textfile\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.874472 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.874452    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32c547b0-702f-49d5-81f2-c05352d1702a-metrics-client-ca\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.874534 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.874475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.876332 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.876311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:56.885031 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:56.885006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfhn\" (UniqueName: \"kubernetes.io/projected/32c547b0-702f-49d5-81f2-c05352d1702a-kube-api-access-4dfhn\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:57.278678 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.278634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:57.278860 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:57.278830    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 31 22:00:57.278940 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:00:57.278926    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls podName:f40099ec-1860-444b-a4f6-bda5fad32aca nodeName:}" failed. No retries permitted until 2026-07-31 22:00:58.278904976 +0000 UTC m=+50.231991183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-nrjzd" (UID: "f40099ec-1860-444b-a4f6-bda5fad32aca") : secret "openshift-state-metrics-tls" not found
Jul 31 22:00:57.379985 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.379946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-tls\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:57.382941 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.382916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/32c547b0-702f-49d5-81f2-c05352d1702a-node-exporter-tls\") pod \"node-exporter-tvbm5\" (UID: \"32c547b0-702f-49d5-81f2-c05352d1702a\") " pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:57.391227 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.391199    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:00:57.456387 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.456354    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:00:57.456570 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.456525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.459362 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.459333    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 31 22:00:57.459362 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.459360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 31 22:00:57.459550 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.459339    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 31 22:00:57.459550 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.459505    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 31 22:00:57.459722 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.459698    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 31 22:00:57.459836 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.459821    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 31 22:00:57.459903 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.459853    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 31 22:00:57.459958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.459900    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 31 22:00:57.460242 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.460225    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qjf54\""
Jul 31 22:00:57.463554 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.463535    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 31 22:00:57.512810 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.512773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tvbm5"
Jul 31 22:00:57.580867 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.580831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581020 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.580870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581020 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.580899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581020 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.580930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581020 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.580996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581152 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.581033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581152 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.581052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-out\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581152 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.581070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-web-config\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581152 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.581114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581152 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.581138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581324 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.581158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbwtk\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-kube-api-access-tbwtk\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581324 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.581195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.581324 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.581227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682143 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-out\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-web-config\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbwtk\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-kube-api-access-tbwtk\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682398    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.682909 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.682775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.683276 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.683208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.683378 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.683311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.685408 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.685368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.685515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.685417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.685515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.685492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.685515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.685509    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-web-config\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.685734 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.685713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-out\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.685818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.685797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.685877 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.685839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-volume\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.686321 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.686300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.686941 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.686920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.691513 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.691493    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbwtk\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-kube-api-access-tbwtk\") pod \"alertmanager-main-0\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:57.767994 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:57.767963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:00:58.041992 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:58.041960    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c547b0_702f_49d5_81f2_c05352d1702a.slice/crio-83e8ff5ac394061943926859fcf75e9e9e2e5f17eed5db31921eda34ab6e83ca WatchSource:0}: Error finding container 83e8ff5ac394061943926859fcf75e9e9e2e5f17eed5db31921eda34ab6e83ca: Status 404 returned error can't find the container with id 83e8ff5ac394061943926859fcf75e9e9e2e5f17eed5db31921eda34ab6e83ca
Jul 31 22:00:58.198217 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.197812    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:00:58.198979 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:58.198953    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fce72aa_90f5_45ef_9ff6_e892eaa9bdf6.slice/crio-99c1da6988d5c76a5aa582ceeb267193e8354602d958a780563c8aa7590ed7f9 WatchSource:0}: Error finding container 99c1da6988d5c76a5aa582ceeb267193e8354602d958a780563c8aa7590ed7f9: Status 404 returned error can't find the container with id 99c1da6988d5c76a5aa582ceeb267193e8354602d958a780563c8aa7590ed7f9
Jul 31 22:00:58.287630 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.287599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:58.291999 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.291943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40099ec-1860-444b-a4f6-bda5fad32aca-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nrjzd\" (UID: \"f40099ec-1860-444b-a4f6-bda5fad32aca\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:58.341301 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.341272    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"
Jul 31 22:00:58.515230 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.515007    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd"]
Jul 31 22:00:58.519264 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:00:58.519234    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40099ec_1860_444b_a4f6_bda5fad32aca.slice/crio-0bd7243b0ad3d19895b7e1c549fa2c4f7627b2b5dac9f2138df19f2c2f7be159 WatchSource:0}: Error finding container 0bd7243b0ad3d19895b7e1c549fa2c4f7627b2b5dac9f2138df19f2c2f7be159: Status 404 returned error can't find the container with id 0bd7243b0ad3d19895b7e1c549fa2c4f7627b2b5dac9f2138df19f2c2f7be159
Jul 31 22:00:58.780928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.780888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerStarted","Data":"99c1da6988d5c76a5aa582ceeb267193e8354602d958a780563c8aa7590ed7f9"}
Jul 31 22:00:58.783465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.783364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd" event={"ID":"f40099ec-1860-444b-a4f6-bda5fad32aca","Type":"ContainerStarted","Data":"669ee66f1698fd2406eb2198419b9e5c222a284eb13d5cd2173a3f19abbc586a"}
Jul 31 22:00:58.783465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.783419    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd" event={"ID":"f40099ec-1860-444b-a4f6-bda5fad32aca","Type":"ContainerStarted","Data":"ffefafac90312271147439b34feb3da6d1872facefe5b48e78a561ea5e175bab"}
Jul 31 22:00:58.783465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.783439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd" event={"ID":"f40099ec-1860-444b-a4f6-bda5fad32aca","Type":"ContainerStarted","Data":"0bd7243b0ad3d19895b7e1c549fa2c4f7627b2b5dac9f2138df19f2c2f7be159"}
Jul 31 22:00:58.785034 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.784977    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvbm5" event={"ID":"32c547b0-702f-49d5-81f2-c05352d1702a","Type":"ContainerStarted","Data":"83e8ff5ac394061943926859fcf75e9e9e2e5f17eed5db31921eda34ab6e83ca"}
Jul 31 22:00:58.786844 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.786819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6fc6479d-zh4zb" event={"ID":"6adb9307-e39b-4d7b-80d4-957a27fb3e01","Type":"ContainerStarted","Data":"0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e"}
Jul 31 22:00:58.789545 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.789487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6zjb" event={"ID":"7e0435e4-3a55-4a9a-be11-18ae6a977ed8","Type":"ContainerStarted","Data":"1f43e662c2eb119dc41a5525ea2b7bc4ad8e215a12d333a5a3acbd373ee56fd5"}
Jul 31 22:00:58.791444 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.791413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qzbqb" event={"ID":"ee93c397-3f4a-4688-97ae-33f8f5be1d3a","Type":"ContainerStarted","Data":"64920e94a2cd81de8964b9f84dfd47c2407dec87fe25c761e855f379ac579342"}
Jul 31 22:00:58.794481 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.794454    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qrftk" event={"ID":"edce7d28-6289-4102-8fa4-73cdc5dac0f7","Type":"ContainerStarted","Data":"8c57768ec97f24c4596503fec0945f6ea70a31127fca7358c0ce20acceb3b81c"}
Jul 31 22:00:58.794591 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.794509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qrftk" event={"ID":"edce7d28-6289-4102-8fa4-73cdc5dac0f7","Type":"ContainerStarted","Data":"5d36f7aca3d4d63fe8f2c06b19935f17489fb394dc0edb9749908c7eb2012bf1"}
Jul 31 22:00:58.794773 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.794753    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qrftk"
Jul 31 22:00:58.825214 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.824595    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qzbqb" podStartSLOduration=2.23630165 podStartE2EDuration="6.824574354s" totalImagesPullingTime="4.588272704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:58.823554359 +0000 UTC m=+50.776640589" watchObservedRunningTime="2026-07-31 22:00:58.824574354 +0000 UTC m=+50.777660578"
Jul 31 22:00:58.825214 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.825022    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6fc6479d-zh4zb" podStartSLOduration=2.299301388 podStartE2EDuration="6.825005798s" totalImagesPullingTime="4.52570441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:58.808164625 +0000 UTC m=+50.761250855" watchObservedRunningTime="2026-07-31 22:00:58.825005798 +0000 UTC m=+50.778092028"
Jul 31 22:00:58.856343 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:58.855337    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qrftk" podStartSLOduration=2.267842488 podStartE2EDuration="6.855314193s" totalImagesPullingTime="4.587471705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:58.85363196 +0000 UTC m=+50.806718214" watchObservedRunningTime="2026-07-31 22:00:58.855314193 +0000 UTC m=+50.808400423"
Jul 31 22:00:59.410109 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.410075    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5494ff649f-pcvzn"]
Jul 31 22:00:59.424933 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.424903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.427931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.427903    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 31 22:00:59.427931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.427906    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 31 22:00:59.428154 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.427981    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 31 22:00:59.428154 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.427905    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dvui9hd4c0gao\""
Jul 31 22:00:59.428154 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.427910    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 31 22:00:59.428336 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.428320    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5psxc\""
Jul 31 22:00:59.428612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.428584    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 31 22:00:59.434081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.433252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5494ff649f-pcvzn"]
Jul 31 22:00:59.500784 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.500753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-grpc-tls\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.501083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.500809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-tls\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.501083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.500865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-metrics-client-ca\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.501083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.500921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.501083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.500948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.501083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.500976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.501083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.501005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.501083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.501033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwvhv\" (UniqueName: \"kubernetes.io/projected/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-kube-api-access-zwvhv\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.602398 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.602360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-grpc-tls\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.602848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.602414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-tls\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.602848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.602461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-metrics-client-ca\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.602848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.602522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.602848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.602547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.602848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.602578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.602848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.602613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.603211 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.603014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwvhv\" (UniqueName: \"kubernetes.io/projected/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-kube-api-access-zwvhv\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.603376 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.603327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-metrics-client-ca\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.606814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.606759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.606814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.606768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.607000 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.606773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.607000 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.606935    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-grpc-tls\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.607403 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.607379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-tls\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.608365 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.608342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.616908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.616885    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwvhv\" (UniqueName: \"kubernetes.io/projected/cff824cd-204e-4e17-9c7d-ea2b7c999f6f-kube-api-access-zwvhv\") pod \"thanos-querier-5494ff649f-pcvzn\" (UID: \"cff824cd-204e-4e17-9c7d-ea2b7c999f6f\") " pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:00:59.736529 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:00:59.736439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:01:00.458443 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.458410    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5494ff649f-pcvzn"]
Jul 31 22:01:00.463011 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:00.462975    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff824cd_204e_4e17_9c7d_ea2b7c999f6f.slice/crio-c02c9d9841672b707812021168763172b79d8fa75d88b0e45b82f0bbfb563d40 WatchSource:0}: Error finding container c02c9d9841672b707812021168763172b79d8fa75d88b0e45b82f0bbfb563d40: Status 404 returned error can't find the container with id c02c9d9841672b707812021168763172b79d8fa75d88b0e45b82f0bbfb563d40
Jul 31 22:01:00.802722 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.802643    2577 generic.go:356] "Generic (PLEG): container finished" podID="32c547b0-702f-49d5-81f2-c05352d1702a" containerID="33bbee4bf502249c3aacdfc90648b40367ec02d5c23bb0334b061acb792a071a" exitCode=0
Jul 31 22:01:00.803488 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.802723    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvbm5" event={"ID":"32c547b0-702f-49d5-81f2-c05352d1702a","Type":"ContainerDied","Data":"33bbee4bf502249c3aacdfc90648b40367ec02d5c23bb0334b061acb792a071a"}
Jul 31 22:01:00.804916 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.804893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6zjb" event={"ID":"7e0435e4-3a55-4a9a-be11-18ae6a977ed8","Type":"ContainerStarted","Data":"e1f3934eb523e82eb4c92d54d1f029f9d6dceeb4b56f229b68daf87ce6fdda67"}
Jul 31 22:01:00.805973 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.805952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn" event={"ID":"cff824cd-204e-4e17-9c7d-ea2b7c999f6f","Type":"ContainerStarted","Data":"c02c9d9841672b707812021168763172b79d8fa75d88b0e45b82f0bbfb563d40"}
Jul 31 22:01:00.807344 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.807323    2577 generic.go:356] "Generic (PLEG): container finished" podID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerID="9033b905dda7407b4136e46030938507af05389b0411076c99a995e9fa55ec70" exitCode=0
Jul 31 22:01:00.807404 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.807350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerDied","Data":"9033b905dda7407b4136e46030938507af05389b0411076c99a995e9fa55ec70"}
Jul 31 22:01:00.849278 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.849008    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x6zjb" podStartSLOduration=2.320135792 podStartE2EDuration="8.848994444s" totalImagesPullingTime="6.528858652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:00.848498759 +0000 UTC m=+52.801584987" watchObservedRunningTime="2026-07-31 22:01:00.848994444 +0000 UTC m=+52.802080673"
Jul 31 22:01:00.948211 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.946463    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"]
Jul 31 22:01:00.962814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.962790    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"]
Jul 31 22:01:00.962908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.962894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:00.965599 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.965569    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 31 22:01:00.965599 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.965578    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 31 22:01:00.965761 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.965578    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6ppn2\""
Jul 31 22:01:00.966057 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.966038    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 31 22:01:00.966365 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.966343    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 31 22:01:00.966423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:00.966385    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6oeagerno9ei8\""
Jul 31 22:01:01.016823 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.016792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-audit-log\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.016916 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.016849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.016954 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.016921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-secret-metrics-server-client-certs\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.016985 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.016953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6z9\" (UniqueName: \"kubernetes.io/projected/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-kube-api-access-kh6z9\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.017015 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.016985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-client-ca-bundle\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.017051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.017028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-secret-metrics-server-tls\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.017081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.017054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-metrics-server-audit-profiles\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.109076 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.109044    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"]
Jul 31 22:01:01.118213 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.118170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-client-ca-bundle\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.118293 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.118238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-secret-metrics-server-tls\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.118293 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.118269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-metrics-server-audit-profiles\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.118384 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.118355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-audit-log\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.118569 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.118547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.118651 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.118597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-secret-metrics-server-client-certs\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.118651 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.118621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6z9\" (UniqueName: \"kubernetes.io/projected/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-kube-api-access-kh6z9\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.118752 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.118698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-audit-log\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.119350 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.119320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.119441 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.119393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-metrics-server-audit-profiles\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.121764 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.121715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-secret-metrics-server-tls\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.121844 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.121767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-secret-metrics-server-client-certs\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.121922 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.121899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-client-ca-bundle\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.122023 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.122000    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:01.123362 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.123342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"]
Jul 31 22:01:01.124399 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.124374    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 31 22:01:01.124571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.124556    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k297p\""
Jul 31 22:01:01.127971 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.127950    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6z9\" (UniqueName: \"kubernetes.io/projected/b1a7bf62-c376-4e8d-84d3-25f98eeb5729-kube-api-access-kh6z9\") pod \"metrics-server-6b8d5f4c47-vs8rd\" (UID: \"b1a7bf62-c376-4e8d-84d3-25f98eeb5729\") " pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.219322 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.219295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlxpc\" (UniqueName: \"kubernetes.io/projected/ab9b9269-dfda-43b0-8c51-2830d8c3375b-kube-api-access-dlxpc\") pod \"monitoring-plugin-6dffbbd67-5tjjb\" (UID: \"ab9b9269-dfda-43b0-8c51-2830d8c3375b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:01.219457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.219436    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ab9b9269-dfda-43b0-8c51-2830d8c3375b-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-5tjjb\" (UID: \"ab9b9269-dfda-43b0-8c51-2830d8c3375b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:01.273249 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.273223    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:01.320715 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.320680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlxpc\" (UniqueName: \"kubernetes.io/projected/ab9b9269-dfda-43b0-8c51-2830d8c3375b-kube-api-access-dlxpc\") pod \"monitoring-plugin-6dffbbd67-5tjjb\" (UID: \"ab9b9269-dfda-43b0-8c51-2830d8c3375b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:01.320859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.320802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ab9b9269-dfda-43b0-8c51-2830d8c3375b-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-5tjjb\" (UID: \"ab9b9269-dfda-43b0-8c51-2830d8c3375b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:01.320914 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:01:01.320903    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 31 22:01:01.320976 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:01:01.320963    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab9b9269-dfda-43b0-8c51-2830d8c3375b-monitoring-plugin-cert podName:ab9b9269-dfda-43b0-8c51-2830d8c3375b nodeName:}" failed. No retries permitted until 2026-07-31 22:01:01.820944248 +0000 UTC m=+53.774030457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ab9b9269-dfda-43b0-8c51-2830d8c3375b-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-5tjjb" (UID: "ab9b9269-dfda-43b0-8c51-2830d8c3375b") : secret "monitoring-plugin-cert" not found
Jul 31 22:01:01.331328 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.331303    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlxpc\" (UniqueName: \"kubernetes.io/projected/ab9b9269-dfda-43b0-8c51-2830d8c3375b-kube-api-access-dlxpc\") pod \"monitoring-plugin-6dffbbd67-5tjjb\" (UID: \"ab9b9269-dfda-43b0-8c51-2830d8c3375b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:01.418360 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.418328    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"]
Jul 31 22:01:01.422422 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:01.422394    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a7bf62_c376_4e8d_84d3_25f98eeb5729.slice/crio-d4f361f9826687d7a0563296acea88bfe627520b8203a2110d08a79876114202 WatchSource:0}: Error finding container d4f361f9826687d7a0563296acea88bfe627520b8203a2110d08a79876114202: Status 404 returned error can't find the container with id d4f361f9826687d7a0563296acea88bfe627520b8203a2110d08a79876114202
Jul 31 22:01:01.672098 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.672019    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8575889df8-mk6gk"]
Jul 31 22:01:01.698401 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.698369    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8575889df8-mk6gk"]
Jul 31 22:01:01.698574 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.698505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.701066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.701042    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 31 22:01:01.701463 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.701425    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 31 22:01:01.701582 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.701464    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 31 22:01:01.701582 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.701435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8zl6w\""
Jul 31 22:01:01.701582 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.701550    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 31 22:01:01.701737 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.701435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 31 22:01:01.707103 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.707044    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 31 22:01:01.723664 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.723618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-federate-client-tls\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.723850 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.723699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-telemeter-client-tls\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.723850 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.723730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r776f\" (UniqueName: \"kubernetes.io/projected/7797041b-8451-45e0-bfc7-f4b51a59d585-kube-api-access-r776f\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.723850 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.723787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.723850 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.723817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-secret-telemeter-client\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.724033 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.723879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.724033 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.723931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-serving-certs-ca-bundle\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.724033 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.723954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-metrics-client-ca\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.813321 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.813280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd" event={"ID":"b1a7bf62-c376-4e8d-84d3-25f98eeb5729","Type":"ContainerStarted","Data":"d4f361f9826687d7a0563296acea88bfe627520b8203a2110d08a79876114202"}
Jul 31 22:01:01.815781 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.815750    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd" event={"ID":"f40099ec-1860-444b-a4f6-bda5fad32aca","Type":"ContainerStarted","Data":"9f45eb1e1bcd83300366b687537613b70429aecc88203076240bbb6f72781a60"}
Jul 31 22:01:01.818666 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.818639    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvbm5" event={"ID":"32c547b0-702f-49d5-81f2-c05352d1702a","Type":"ContainerStarted","Data":"7e609dd47e8b2056dff1a9be49be32a2430129640d839222f792f6e9369394d8"}
Jul 31 22:01:01.818812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.818694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tvbm5" event={"ID":"32c547b0-702f-49d5-81f2-c05352d1702a","Type":"ContainerStarted","Data":"bc6be5f89f84094891a69b6afbbd7c124cc76edf4d55aaa797d894c8b4f59bd5"}
Jul 31 22:01:01.825379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-serving-certs-ca-bundle\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.825556 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-metrics-client-ca\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.825556 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-federate-client-tls\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.825556 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-telemeter-client-tls\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.825556 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r776f\" (UniqueName: \"kubernetes.io/projected/7797041b-8451-45e0-bfc7-f4b51a59d585-kube-api-access-r776f\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.825763 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.825763 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-secret-telemeter-client\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.825763 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ab9b9269-dfda-43b0-8c51-2830d8c3375b-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-5tjjb\" (UID: \"ab9b9269-dfda-43b0-8c51-2830d8c3375b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:01.825763 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.825692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.826485 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.826193    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-serving-certs-ca-bundle\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.826485 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.826223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-metrics-client-ca\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.826982 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.826948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7797041b-8451-45e0-bfc7-f4b51a59d585-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.829565 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.829541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ab9b9269-dfda-43b0-8c51-2830d8c3375b-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-5tjjb\" (UID: \"ab9b9269-dfda-43b0-8c51-2830d8c3375b\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:01.829678 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.829545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.829678 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.829658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-telemeter-client-tls\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.829752 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.829661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-federate-client-tls\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.829876 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.829855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7797041b-8451-45e0-bfc7-f4b51a59d585-secret-telemeter-client\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.835408 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.835380    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r776f\" (UniqueName: \"kubernetes.io/projected/7797041b-8451-45e0-bfc7-f4b51a59d585-kube-api-access-r776f\") pod \"telemeter-client-8575889df8-mk6gk\" (UID: \"7797041b-8451-45e0-bfc7-f4b51a59d585\") " pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:01.843135 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.843074    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nrjzd" podStartSLOduration=3.371086988 podStartE2EDuration="5.843051848s" totalImagesPullingTime="2.47196486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:01.841362091 +0000 UTC m=+53.794448322" watchObservedRunningTime="2026-07-31 22:01:01.843051848 +0000 UTC m=+53.796138078"
Jul 31 22:01:01.871195 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:01.871118    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tvbm5" podStartSLOduration=3.50873753 podStartE2EDuration="5.871099788s" totalImagesPullingTime="2.232961518s" totalInitContainerRuntime="129.40074ms" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:01.869924769 +0000 UTC m=+53.823011011" watchObservedRunningTime="2026-07-31 22:01:01.871099788 +0000 UTC m=+53.824186017"
Jul 31 22:01:02.011631 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:02.011549    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk"
Jul 31 22:01:02.031943 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:02.031906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:02.204284 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:02.204241    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8575889df8-mk6gk"]
Jul 31 22:01:02.205281 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:02.205207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"]
Jul 31 22:01:02.209542 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:02.209328    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7797041b_8451_45e0_bfc7_f4b51a59d585.slice/crio-fb97c290364a839bcbbff55d4129b0abd10ea1bbdeb52f10a5372c26050e939a WatchSource:0}: Error finding container fb97c290364a839bcbbff55d4129b0abd10ea1bbdeb52f10a5372c26050e939a: Status 404 returned error can't find the container with id fb97c290364a839bcbbff55d4129b0abd10ea1bbdeb52f10a5372c26050e939a
Jul 31 22:01:02.209799 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:02.209779    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9b9269_dfda_43b0_8c51_2830d8c3375b.slice/crio-55fd6d50cfbd6ed3b97596bd00ff4868078a3c2742c7710496015463c0dbfbca WatchSource:0}: Error finding container 55fd6d50cfbd6ed3b97596bd00ff4868078a3c2742c7710496015463c0dbfbca: Status 404 returned error can't find the container with id 55fd6d50cfbd6ed3b97596bd00ff4868078a3c2742c7710496015463c0dbfbca
Jul 31 22:01:02.826613 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:02.826578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk" event={"ID":"7797041b-8451-45e0-bfc7-f4b51a59d585","Type":"ContainerStarted","Data":"fb97c290364a839bcbbff55d4129b0abd10ea1bbdeb52f10a5372c26050e939a"}
Jul 31 22:01:02.827954 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:02.827893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb" event={"ID":"ab9b9269-dfda-43b0-8c51-2830d8c3375b","Type":"ContainerStarted","Data":"55fd6d50cfbd6ed3b97596bd00ff4868078a3c2742c7710496015463c0dbfbca"}
Jul 31 22:01:03.348656 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:03.348623    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:01:03.348841 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:03.348687    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:01:03.354492 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:03.354468    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:01:03.840216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:03.840167    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:01:04.841522 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.841475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn" event={"ID":"cff824cd-204e-4e17-9c7d-ea2b7c999f6f","Type":"ContainerStarted","Data":"9a808942290f168629fc5b50b164729fea931e911fd0648446e6d328ed038f7a"}
Jul 31 22:01:04.841975 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.841591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn" event={"ID":"cff824cd-204e-4e17-9c7d-ea2b7c999f6f","Type":"ContainerStarted","Data":"92fa4333f2fd7ef4b05c645447d9d7c339ea3fd1b5ffd05c0092385c32ea53dd"}
Jul 31 22:01:04.841975 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.841636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn" event={"ID":"cff824cd-204e-4e17-9c7d-ea2b7c999f6f","Type":"ContainerStarted","Data":"a65db43b4d904209f7b7d08ab27be1a30e527d482ebe1e92a00881656c6fe5c9"}
Jul 31 22:01:04.844728 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.844657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerStarted","Data":"95e3d9374795d78cc6515fc193fded22202d032227d93f71b610573d5314b264"}
Jul 31 22:01:04.844860 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.844734    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerStarted","Data":"9df0464ab938ecf4431184b213aed2803f1dbc818e115e2a5298351071b0be99"}
Jul 31 22:01:04.844860 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.844763    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerStarted","Data":"777c02626b3154095a17c921eb386c9125fb8d9f93e56a6ffaa81afa6d81b415"}
Jul 31 22:01:04.844860 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.844785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerStarted","Data":"0fff0de9db5395822b561c7ab426a19e963a85c9b67588edfae142814f4be7c3"}
Jul 31 22:01:04.846316 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.846285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd" event={"ID":"b1a7bf62-c376-4e8d-84d3-25f98eeb5729","Type":"ContainerStarted","Data":"86220711bef454467c6e1cc2dd8be85e05c230c424ff3e40164e8bdc1050e794"}
Jul 31 22:01:04.847866 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.847839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb" event={"ID":"ab9b9269-dfda-43b0-8c51-2830d8c3375b","Type":"ContainerStarted","Data":"bd8b1796ea82b555198b00801ad6a14488df9e898114dd8eb77f42f8866d7451"}
Jul 31 22:01:04.848208 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.848169    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:04.853848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.853826    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb"
Jul 31 22:01:04.864845 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.864796    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd" podStartSLOduration=1.956703687 podStartE2EDuration="4.864778077s" totalImagesPullingTime="2.90807439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:04.864545147 +0000 UTC m=+56.817631399" watchObservedRunningTime="2026-07-31 22:01:04.864778077 +0000 UTC m=+56.817864308"
Jul 31 22:01:04.880629 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:04.880467    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5tjjb" podStartSLOduration=1.728553855 podStartE2EDuration="3.880448715s" totalImagesPullingTime="2.15189486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:04.879969234 +0000 UTC m=+56.833055479" watchObservedRunningTime="2026-07-31 22:01:04.880448715 +0000 UTC m=+56.833534946"
Jul 31 22:01:05.614115 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.614090    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d644cf5d-qp527"]
Jul 31 22:01:05.616668 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.616650    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.624442 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.624418    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 22:01:05.630061 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.630030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d644cf5d-qp527"]
Jul 31 22:01:05.666304 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.666277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktlxm\" (UniqueName: \"kubernetes.io/projected/0e3efadc-fb7a-4ff0-8e5c-f53011549629-kube-api-access-ktlxm\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.666429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.666325    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-oauth-config\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.666487 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.666465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-trusted-ca-bundle\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.666540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.666507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-oauth-serving-cert\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.666595 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.666567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-service-ca\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.666719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.666610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-config\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.666719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.666671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-serving-cert\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.767587 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.767551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktlxm\" (UniqueName: \"kubernetes.io/projected/0e3efadc-fb7a-4ff0-8e5c-f53011549629-kube-api-access-ktlxm\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.767655 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.767585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-oauth-config\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.767700 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.767669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-trusted-ca-bundle\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.767700 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.767694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-oauth-serving-cert\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.767798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.767726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-service-ca\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.767798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.767761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-config\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.767892 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.767825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-serving-cert\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.768590 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.768566    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-oauth-serving-cert\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.768708 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.768606    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-config\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.769095 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.769072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-trusted-ca-bundle\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.769209 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.769115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-service-ca\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.770159 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.770142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-serving-cert\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.770254 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.770229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-oauth-config\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.776699 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.776679    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktlxm\" (UniqueName: \"kubernetes.io/projected/0e3efadc-fb7a-4ff0-8e5c-f53011549629-kube-api-access-ktlxm\") pod \"console-86d644cf5d-qp527\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") " pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.857391 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.857304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerStarted","Data":"284f943dffa996c06c12a02ccd4e2827a9cbbd95b4df1720172752d52fe07cb7"}
Jul 31 22:01:05.857800 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.857420    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerStarted","Data":"55e1e26e4f8dcd679e30d369d59bf098a138143cc7d7054890e59019a60d8a1a"}
Jul 31 22:01:05.860331 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.860305    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn" event={"ID":"cff824cd-204e-4e17-9c7d-ea2b7c999f6f","Type":"ContainerStarted","Data":"a5bbe22b90cd4a1e6d688b7a15b7f417f7be73e7768ced67ead58d1c4567b79e"}
Jul 31 22:01:05.860467 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.860373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn" event={"ID":"cff824cd-204e-4e17-9c7d-ea2b7c999f6f","Type":"ContainerStarted","Data":"bf5807a0a8d4fc6a74de04d2b430020ea6f0c8115bede6c4af0915a9df176a37"}
Jul 31 22:01:05.860467 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.860420    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:01:05.860467 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.860463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn" event={"ID":"cff824cd-204e-4e17-9c7d-ea2b7c999f6f","Type":"ContainerStarted","Data":"156ffa3c24847fcadd9be9573792edc042d0c5da5f7a88bcc6f3a1b6669fa367"}
Jul 31 22:01:05.862379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.862353    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk" event={"ID":"7797041b-8451-45e0-bfc7-f4b51a59d585","Type":"ContainerStarted","Data":"e2ff5e425d1a9df70030dc2bc27381a67b4ca923b916908cfb92b1a61717bb2a"}
Jul 31 22:01:05.862505 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.862405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk" event={"ID":"7797041b-8451-45e0-bfc7-f4b51a59d585","Type":"ContainerStarted","Data":"7f632b5b260296fb684764eed3df8ddd9a651c7d8e5989d5d87af72a3343b85f"}
Jul 31 22:01:05.862505 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.862436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk" event={"ID":"7797041b-8451-45e0-bfc7-f4b51a59d585","Type":"ContainerStarted","Data":"e90723fd8ea6f3e31e33c1fa157c8012016f9b434545dce556c52a3eab0fb4d2"}
Jul 31 22:01:05.897230 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.897139    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.752515167 podStartE2EDuration="8.897118628s" totalImagesPullingTime="6.117951179s" totalInitContainerRuntime="26.652282ms" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:05.896957389 +0000 UTC m=+57.850043619" watchObservedRunningTime="2026-07-31 22:01:05.897118628 +0000 UTC m=+57.850204858"
Jul 31 22:01:05.929518 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.929470    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn" podStartSLOduration=2.081430238 podStartE2EDuration="6.929452679s" totalImagesPullingTime="4.848022441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:05.927254151 +0000 UTC m=+57.880340381" watchObservedRunningTime="2026-07-31 22:01:05.929452679 +0000 UTC m=+57.882538907"
Jul 31 22:01:05.942341 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.942316    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:05.958822 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:05.958776    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8575889df8-mk6gk" podStartSLOduration=2.046725416 podStartE2EDuration="4.958759345s" totalImagesPullingTime="2.912033929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:05.957812651 +0000 UTC m=+57.910898879" watchObservedRunningTime="2026-07-31 22:01:05.958759345 +0000 UTC m=+57.911845573"
Jul 31 22:01:06.079927 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.079897    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d644cf5d-qp527"]
Jul 31 22:01:06.082741 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:06.082714    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3efadc_fb7a_4ff0_8e5c_f53011549629.slice/crio-791445cb86c1d3b406138fdd6372750d18a648e1e3a6ab287aa54a48b0e2aca8 WatchSource:0}: Error finding container 791445cb86c1d3b406138fdd6372750d18a648e1e3a6ab287aa54a48b0e2aca8: Status 404 returned error can't find the container with id 791445cb86c1d3b406138fdd6372750d18a648e1e3a6ab287aa54a48b0e2aca8
Jul 31 22:01:06.208523 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.208486    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d644cf5d-qp527"]
Jul 31 22:01:06.248627 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.248596    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cb6559b46-vmxns"]
Jul 31 22:01:06.250912 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.250898    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.269729 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.269694    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb6559b46-vmxns"]
Jul 31 22:01:06.375411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.375322    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kjr9\" (UniqueName: \"kubernetes.io/projected/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-kube-api-access-4kjr9\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.375411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.375380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-config\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.375411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.375407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-trusted-ca-bundle\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.375667 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.375440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-serving-cert\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.375667 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.375464    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-oauth-config\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.375667 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.375505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-oauth-serving-cert\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.375667 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.375560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-service-ca\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.476232 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.476170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-serving-cert\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.476405 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.476247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-oauth-config\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.476405 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.476267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-oauth-serving-cert\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.476405 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.476296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-service-ca\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.476405 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.476391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kjr9\" (UniqueName: \"kubernetes.io/projected/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-kube-api-access-4kjr9\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.476619 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.476430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-config\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.476619 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.476451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-trusted-ca-bundle\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.477051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.477029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-oauth-serving-cert\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.477141 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.477119    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-config\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.477291 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.477273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-service-ca\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.477510 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.477488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-trusted-ca-bundle\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.478737 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.478712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-serving-cert\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.478819 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.478757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-oauth-config\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.495946 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.495924    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kjr9\" (UniqueName: \"kubernetes.io/projected/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-kube-api-access-4kjr9\") pod \"console-6cb6559b46-vmxns\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") " pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.560161 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.560121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:06.717917 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.717894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb6559b46-vmxns"]
Jul 31 22:01:06.719826 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:06.719793    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6e40ac_6ecd_4ec4_9cf1_7610b0f920d6.slice/crio-a5fb32498c700f2065301b80980ba4f35d256f6278d690f9bc9cecb7bd8203ac WatchSource:0}: Error finding container a5fb32498c700f2065301b80980ba4f35d256f6278d690f9bc9cecb7bd8203ac: Status 404 returned error can't find the container with id a5fb32498c700f2065301b80980ba4f35d256f6278d690f9bc9cecb7bd8203ac
Jul 31 22:01:06.869032 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.868994    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d644cf5d-qp527" event={"ID":"0e3efadc-fb7a-4ff0-8e5c-f53011549629","Type":"ContainerStarted","Data":"68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe"}
Jul 31 22:01:06.869485 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.869056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d644cf5d-qp527" event={"ID":"0e3efadc-fb7a-4ff0-8e5c-f53011549629","Type":"ContainerStarted","Data":"791445cb86c1d3b406138fdd6372750d18a648e1e3a6ab287aa54a48b0e2aca8"}
Jul 31 22:01:06.870617 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.870589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb6559b46-vmxns" event={"ID":"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6","Type":"ContainerStarted","Data":"eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151"}
Jul 31 22:01:06.870741 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.870632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb6559b46-vmxns" event={"ID":"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6","Type":"ContainerStarted","Data":"a5fb32498c700f2065301b80980ba4f35d256f6278d690f9bc9cecb7bd8203ac"}
Jul 31 22:01:06.911286 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.911137    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d644cf5d-qp527" podStartSLOduration=1.9111217219999999 podStartE2EDuration="1.911121722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:06.899834846 +0000 UTC m=+58.852921077" watchObservedRunningTime="2026-07-31 22:01:06.911121722 +0000 UTC m=+58.864207934"
Jul 31 22:01:06.936814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:06.936764    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cb6559b46-vmxns" podStartSLOduration=0.936746953 podStartE2EDuration="936.746953ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:06.936440846 +0000 UTC m=+58.889527074" watchObservedRunningTime="2026-07-31 22:01:06.936746953 +0000 UTC m=+58.889833181"
Jul 31 22:01:08.800128 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:08.800100    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qrftk"
Jul 31 22:01:09.726090 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:09.726061    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktsvj"
Jul 31 22:01:11.878250 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:11.878222    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5494ff649f-pcvzn"
Jul 31 22:01:13.240804 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.240754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:01:13.243626 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.243606    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 22:01:13.253808 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.253784    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d379655c-3ced-4866-bfd2-efd0f5e8136f-metrics-certs\") pod \"network-metrics-daemon-fj6jp\" (UID: \"d379655c-3ced-4866-bfd2-efd0f5e8136f\") " pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:01:13.341819 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.341778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:01:13.344770 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.344741    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 22:01:13.355514 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.355489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06942b15-d888-43d5-8cea-f897b295ef40-original-pull-secret\") pod \"global-pull-secret-syncer-4wg9f\" (UID: \"06942b15-d888-43d5-8cea-f897b295ef40\") " pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:01:13.443228 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.443167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:01:13.446054 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.446035    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 22:01:13.457355 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.457327    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 22:01:13.457488 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.457471    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sb6cn\""
Jul 31 22:01:13.464155 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.464137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wg9f"
Jul 31 22:01:13.465169 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.465154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fj6jp"
Jul 31 22:01:13.467537 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.467519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2p7r\" (UniqueName: \"kubernetes.io/projected/3b9a02d4-3e95-4222-ad58-8e3d93146bf2-kube-api-access-t2p7r\") pod \"network-check-target-pg25b\" (UID: \"3b9a02d4-3e95-4222-ad58-8e3d93146bf2\") " pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:01:13.600506 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.600475    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fj6jp"]
Jul 31 22:01:13.603553 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:13.603523    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd379655c_3ced_4866_bfd2_efd0f5e8136f.slice/crio-c8a82b504867e8d91461a695cff9337f507d4a309ffad0fc92e0d720fa8510ad WatchSource:0}: Error finding container c8a82b504867e8d91461a695cff9337f507d4a309ffad0fc92e0d720fa8510ad: Status 404 returned error can't find the container with id c8a82b504867e8d91461a695cff9337f507d4a309ffad0fc92e0d720fa8510ad
Jul 31 22:01:13.619343 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.619302    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4wg9f"]
Jul 31 22:01:13.621234 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:13.621214    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06942b15_d888_43d5_8cea_f897b295ef40.slice/crio-b226f9ae03beb75546e00dbe5c00e7ad73338d86c2e2f5c98411b7dfb7768168 WatchSource:0}: Error finding container b226f9ae03beb75546e00dbe5c00e7ad73338d86c2e2f5c98411b7dfb7768168: Status 404 returned error can't find the container with id b226f9ae03beb75546e00dbe5c00e7ad73338d86c2e2f5c98411b7dfb7768168
Jul 31 22:01:13.743844 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.743810    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nslhh\""
Jul 31 22:01:13.751738 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.751712    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:01:13.887654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.887632    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pg25b"]
Jul 31 22:01:13.889837 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:01:13.889807    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9a02d4_3e95_4222_ad58_8e3d93146bf2.slice/crio-e12609f06f89772be24eef807b39907b4246622f17e17678fa8e7f449a1621a4 WatchSource:0}: Error finding container e12609f06f89772be24eef807b39907b4246622f17e17678fa8e7f449a1621a4: Status 404 returned error can't find the container with id e12609f06f89772be24eef807b39907b4246622f17e17678fa8e7f449a1621a4
Jul 31 22:01:13.898433 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.898410    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pg25b" event={"ID":"3b9a02d4-3e95-4222-ad58-8e3d93146bf2","Type":"ContainerStarted","Data":"e12609f06f89772be24eef807b39907b4246622f17e17678fa8e7f449a1621a4"}
Jul 31 22:01:13.899475 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.899452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fj6jp" event={"ID":"d379655c-3ced-4866-bfd2-efd0f5e8136f","Type":"ContainerStarted","Data":"c8a82b504867e8d91461a695cff9337f507d4a309ffad0fc92e0d720fa8510ad"}
Jul 31 22:01:13.900518 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:13.900490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4wg9f" event={"ID":"06942b15-d888-43d5-8cea-f897b295ef40","Type":"ContainerStarted","Data":"b226f9ae03beb75546e00dbe5c00e7ad73338d86c2e2f5c98411b7dfb7768168"}
Jul 31 22:01:14.909084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:14.908989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fj6jp" event={"ID":"d379655c-3ced-4866-bfd2-efd0f5e8136f","Type":"ContainerStarted","Data":"3deff6f4adf3249b6c49c5c97129b70e5f5c94e6ddff47bddaee4b83277b6ac6"}
Jul 31 22:01:14.909084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:14.909059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fj6jp" event={"ID":"d379655c-3ced-4866-bfd2-efd0f5e8136f","Type":"ContainerStarted","Data":"00ebbec5e57b73f47ef0444185a6df929b6e8ae2b5aa98657b6472bb12c32f89"}
Jul 31 22:01:14.928494 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:14.928432    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fj6jp" podStartSLOduration=64.932813051 podStartE2EDuration="1m5.928409431s" totalImagesPullingTime="995.59638ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:14.926415866 +0000 UTC m=+66.879502095" watchObservedRunningTime="2026-07-31 22:01:14.928409431 +0000 UTC m=+66.881495662"
Jul 31 22:01:15.942733 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:15.942692    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:16.560884 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:16.560850    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:16.561059 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:16.560910    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:16.566305 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:16.566279    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:16.923444 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:16.923410    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:01:16.996840 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:16.996809    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6fc6479d-zh4zb"]
Jul 31 22:01:18.929084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:18.929041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pg25b" event={"ID":"3b9a02d4-3e95-4222-ad58-8e3d93146bf2","Type":"ContainerStarted","Data":"a5bc4491242d55ea1d86c1896d2a6ba061c554c472853a371645dd50177797ad"}
Jul 31 22:01:18.929603 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:18.929166    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:01:18.930603 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:18.930580    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4wg9f" event={"ID":"06942b15-d888-43d5-8cea-f897b295ef40","Type":"ContainerStarted","Data":"4df28d4053739600763dbfa23b824b0929b9882d78d47eec15beb5a4c55d8c89"}
Jul 31 22:01:18.960418 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:18.960374    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pg25b" podStartSLOduration=65.327403659 podStartE2EDuration="1m9.960359514s" totalImagesPullingTime="4.632955855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:18.960156848 +0000 UTC m=+70.913243080" watchObservedRunningTime="2026-07-31 22:01:18.960359514 +0000 UTC m=+70.913445758"
Jul 31 22:01:18.989744 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:18.989691    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4wg9f" podStartSLOduration=65.078591042 podStartE2EDuration="1m9.989676552s" totalImagesPullingTime="4.91108551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:18.987353744 +0000 UTC m=+70.940439972" watchObservedRunningTime="2026-07-31 22:01:18.989676552 +0000 UTC m=+70.942762780"
Jul 31 22:01:21.273627 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:21.273591    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:21.274088 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:21.273661    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:32.893931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:32.893790    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d644cf5d-qp527" podUID="0e3efadc-fb7a-4ff0-8e5c-f53011549629" containerName="console" containerID="cri-o://68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe" gracePeriod=15
Jul 31 22:01:33.124489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.124465    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:33.218949 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.218851    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-service-ca\") pod \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") "
Jul 31 22:01:33.218949 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.218914    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-oauth-serving-cert\") pod \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") "
Jul 31 22:01:33.219202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.218951    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-config\") pod \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") "
Jul 31 22:01:33.219202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.218984    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktlxm\" (UniqueName: \"kubernetes.io/projected/0e3efadc-fb7a-4ff0-8e5c-f53011549629-kube-api-access-ktlxm\") pod \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") "
Jul 31 22:01:33.219202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.219039    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-serving-cert\") pod \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") "
Jul 31 22:01:33.219202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.219078    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-trusted-ca-bundle\") pod \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") "
Jul 31 22:01:33.219202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.219114    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-oauth-config\") pod \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\" (UID: \"0e3efadc-fb7a-4ff0-8e5c-f53011549629\") "
Jul 31 22:01:33.219431 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.219385    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e3efadc-fb7a-4ff0-8e5c-f53011549629" (UID: "0e3efadc-fb7a-4ff0-8e5c-f53011549629"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:33.219431 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.219404    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e3efadc-fb7a-4ff0-8e5c-f53011549629" (UID: "0e3efadc-fb7a-4ff0-8e5c-f53011549629"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:33.219605 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.219579    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-config" (OuterVolumeSpecName: "console-config") pod "0e3efadc-fb7a-4ff0-8e5c-f53011549629" (UID: "0e3efadc-fb7a-4ff0-8e5c-f53011549629"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:33.219675 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.219648    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0e3efadc-fb7a-4ff0-8e5c-f53011549629" (UID: "0e3efadc-fb7a-4ff0-8e5c-f53011549629"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:33.221577 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.221551    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e3efadc-fb7a-4ff0-8e5c-f53011549629-kube-api-access-ktlxm" (OuterVolumeSpecName: "kube-api-access-ktlxm") pod "0e3efadc-fb7a-4ff0-8e5c-f53011549629" (UID: "0e3efadc-fb7a-4ff0-8e5c-f53011549629"). InnerVolumeSpecName "kube-api-access-ktlxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:01:33.221674 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.221576    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e3efadc-fb7a-4ff0-8e5c-f53011549629" (UID: "0e3efadc-fb7a-4ff0-8e5c-f53011549629"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:01:33.221674 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.221615    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e3efadc-fb7a-4ff0-8e5c-f53011549629" (UID: "0e3efadc-fb7a-4ff0-8e5c-f53011549629"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:01:33.320628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.320596    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-serving-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:33.320628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.320625    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-trusted-ca-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:33.320628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.320634    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-oauth-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:33.320856 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.320643    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:33.320856 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.320653    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-oauth-serving-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:33.320856 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.320666    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e3efadc-fb7a-4ff0-8e5c-f53011549629-console-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:33.320856 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.320676    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktlxm\" (UniqueName: \"kubernetes.io/projected/0e3efadc-fb7a-4ff0-8e5c-f53011549629-kube-api-access-ktlxm\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:33.993149 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.993112    2577 generic.go:356] "Generic (PLEG): container finished" podID="0e3efadc-fb7a-4ff0-8e5c-f53011549629" containerID="68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe" exitCode=0
Jul 31 22:01:33.993614 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.993160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d644cf5d-qp527" event={"ID":"0e3efadc-fb7a-4ff0-8e5c-f53011549629","Type":"ContainerDied","Data":"68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe"}
Jul 31 22:01:33.993614 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.993166    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d644cf5d-qp527"
Jul 31 22:01:33.993614 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.993252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d644cf5d-qp527" event={"ID":"0e3efadc-fb7a-4ff0-8e5c-f53011549629","Type":"ContainerDied","Data":"791445cb86c1d3b406138fdd6372750d18a648e1e3a6ab287aa54a48b0e2aca8"}
Jul 31 22:01:33.993614 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:33.993284    2577 scope.go:117] "RemoveContainer" containerID="68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe"
Jul 31 22:01:34.002351 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:34.002331    2577 scope.go:117] "RemoveContainer" containerID="68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe"
Jul 31 22:01:34.002620 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:01:34.002600    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe\": container with ID starting with 68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe not found: ID does not exist" containerID="68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe"
Jul 31 22:01:34.002667 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:34.002630    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe"} err="failed to get container status \"68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe\": rpc error: code = NotFound desc = could not find container \"68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe\": container with ID starting with 68119a61f9426d112af11ff60a18169dac0784c797d4b15eca39075cc8f2b5fe not found: ID does not exist"
Jul 31 22:01:34.019093 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:34.019071    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d644cf5d-qp527"]
Jul 31 22:01:34.023790 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:34.023766    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d644cf5d-qp527"]
Jul 31 22:01:34.531595 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:34.531563    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e3efadc-fb7a-4ff0-8e5c-f53011549629" path="/var/lib/kubelet/pods/0e3efadc-fb7a-4ff0-8e5c-f53011549629/volumes"
Jul 31 22:01:41.279606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:41.279572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:41.283488 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:41.283467    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b8d5f4c47-vs8rd"
Jul 31 22:01:42.021147 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.021102    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c6fc6479d-zh4zb" podUID="6adb9307-e39b-4d7b-80d4-957a27fb3e01" containerName="console" containerID="cri-o://0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e" gracePeriod=15
Jul 31 22:01:42.262400 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.262375    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:01:42.288913 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.288833    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-config\") pod \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") "
Jul 31 22:01:42.288913 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.288892    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrngh\" (UniqueName: \"kubernetes.io/projected/6adb9307-e39b-4d7b-80d4-957a27fb3e01-kube-api-access-qrngh\") pod \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") "
Jul 31 22:01:42.289423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.288920    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-oauth-config\") pod \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") "
Jul 31 22:01:42.289423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.288961    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-service-ca\") pod \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") "
Jul 31 22:01:42.289423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.288991    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-oauth-serving-cert\") pod \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") "
Jul 31 22:01:42.289423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.289029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-serving-cert\") pod \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\" (UID: \"6adb9307-e39b-4d7b-80d4-957a27fb3e01\") "
Jul 31 22:01:42.289423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.289349    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-config" (OuterVolumeSpecName: "console-config") pod "6adb9307-e39b-4d7b-80d4-957a27fb3e01" (UID: "6adb9307-e39b-4d7b-80d4-957a27fb3e01"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:42.289648 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.289587    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6adb9307-e39b-4d7b-80d4-957a27fb3e01" (UID: "6adb9307-e39b-4d7b-80d4-957a27fb3e01"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:42.289754 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.289732    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-service-ca" (OuterVolumeSpecName: "service-ca") pod "6adb9307-e39b-4d7b-80d4-957a27fb3e01" (UID: "6adb9307-e39b-4d7b-80d4-957a27fb3e01"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:42.291370 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.291338    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6adb9307-e39b-4d7b-80d4-957a27fb3e01-kube-api-access-qrngh" (OuterVolumeSpecName: "kube-api-access-qrngh") pod "6adb9307-e39b-4d7b-80d4-957a27fb3e01" (UID: "6adb9307-e39b-4d7b-80d4-957a27fb3e01"). InnerVolumeSpecName "kube-api-access-qrngh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:01:42.291737 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.291700    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6adb9307-e39b-4d7b-80d4-957a27fb3e01" (UID: "6adb9307-e39b-4d7b-80d4-957a27fb3e01"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:01:42.291834 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.291748    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6adb9307-e39b-4d7b-80d4-957a27fb3e01" (UID: "6adb9307-e39b-4d7b-80d4-957a27fb3e01"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:01:42.390565 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.390532    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:42.390565 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.390563    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-oauth-serving-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:42.390565 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.390573    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-serving-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:42.390787 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.390582    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:42.390787 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.390592    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrngh\" (UniqueName: \"kubernetes.io/projected/6adb9307-e39b-4d7b-80d4-957a27fb3e01-kube-api-access-qrngh\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:42.390787 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:42.390600    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6adb9307-e39b-4d7b-80d4-957a27fb3e01-console-oauth-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:01:43.032625 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.032589    2577 generic.go:356] "Generic (PLEG): container finished" podID="6adb9307-e39b-4d7b-80d4-957a27fb3e01" containerID="0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e" exitCode=0
Jul 31 22:01:43.032831 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.032647    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6fc6479d-zh4zb"
Jul 31 22:01:43.032831 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.032677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6fc6479d-zh4zb" event={"ID":"6adb9307-e39b-4d7b-80d4-957a27fb3e01","Type":"ContainerDied","Data":"0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e"}
Jul 31 22:01:43.032831 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.032738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6fc6479d-zh4zb" event={"ID":"6adb9307-e39b-4d7b-80d4-957a27fb3e01","Type":"ContainerDied","Data":"f451eab425b8070db3c074c490142fa7940e9921321d25fee4df01d3b555561f"}
Jul 31 22:01:43.032831 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.032766    2577 scope.go:117] "RemoveContainer" containerID="0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e"
Jul 31 22:01:43.040654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.040633    2577 scope.go:117] "RemoveContainer" containerID="0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e"
Jul 31 22:01:43.040956 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:01:43.040937    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e\": container with ID starting with 0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e not found: ID does not exist" containerID="0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e"
Jul 31 22:01:43.041020 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.040967    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e"} err="failed to get container status \"0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e\": rpc error: code = NotFound desc = could not find container \"0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e\": container with ID starting with 0395b71f21205cad7c8c40d1d1386fe9de555453985f312cb10eea481ef7cc3e not found: ID does not exist"
Jul 31 22:01:43.049300 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.049271    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6fc6479d-zh4zb"]
Jul 31 22:01:43.053751 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:43.053726    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6fc6479d-zh4zb"]
Jul 31 22:01:44.530977 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:44.530943    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6adb9307-e39b-4d7b-80d4-957a27fb3e01" path="/var/lib/kubelet/pods/6adb9307-e39b-4d7b-80d4-957a27fb3e01/volumes"
Jul 31 22:01:49.937654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:01:49.937621    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pg25b"
Jul 31 22:02:16.964867 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:16.964830    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:02:16.965385 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:16.965118    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="alertmanager" containerID="cri-o://0fff0de9db5395822b561c7ab426a19e963a85c9b67588edfae142814f4be7c3" gracePeriod=120
Jul 31 22:02:16.965385 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:16.965208    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy-metric" containerID="cri-o://55e1e26e4f8dcd679e30d369d59bf098a138143cc7d7054890e59019a60d8a1a" gracePeriod=120
Jul 31 22:02:16.965385 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:16.965232    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="prom-label-proxy" containerID="cri-o://284f943dffa996c06c12a02ccd4e2827a9cbbd95b4df1720172752d52fe07cb7" gracePeriod=120
Jul 31 22:02:16.965385 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:16.965263    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy" containerID="cri-o://95e3d9374795d78cc6515fc193fded22202d032227d93f71b610573d5314b264" gracePeriod=120
Jul 31 22:02:16.965385 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:16.965279    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="config-reloader" containerID="cri-o://777c02626b3154095a17c921eb386c9125fb8d9f93e56a6ffaa81afa6d81b415" gracePeriod=120
Jul 31 22:02:16.965385 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:16.965250    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy-web" containerID="cri-o://9df0464ab938ecf4431184b213aed2803f1dbc818e115e2a5298351071b0be99" gracePeriod=120
Jul 31 22:02:17.169084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:17.169050    2577 generic.go:356] "Generic (PLEG): container finished" podID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerID="284f943dffa996c06c12a02ccd4e2827a9cbbd95b4df1720172752d52fe07cb7" exitCode=0
Jul 31 22:02:17.169084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:17.169076    2577 generic.go:356] "Generic (PLEG): container finished" podID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerID="95e3d9374795d78cc6515fc193fded22202d032227d93f71b610573d5314b264" exitCode=0
Jul 31 22:02:17.169084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:17.169083    2577 generic.go:356] "Generic (PLEG): container finished" podID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerID="777c02626b3154095a17c921eb386c9125fb8d9f93e56a6ffaa81afa6d81b415" exitCode=0
Jul 31 22:02:17.169084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:17.169089    2577 generic.go:356] "Generic (PLEG): container finished" podID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerID="0fff0de9db5395822b561c7ab426a19e963a85c9b67588edfae142814f4be7c3" exitCode=0
Jul 31 22:02:17.169393 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:17.169116    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerDied","Data":"284f943dffa996c06c12a02ccd4e2827a9cbbd95b4df1720172752d52fe07cb7"}
Jul 31 22:02:17.169393 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:17.169208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerDied","Data":"95e3d9374795d78cc6515fc193fded22202d032227d93f71b610573d5314b264"}
Jul 31 22:02:17.169393 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:17.169236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerDied","Data":"777c02626b3154095a17c921eb386c9125fb8d9f93e56a6ffaa81afa6d81b415"}
Jul 31 22:02:17.169393 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:17.169266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerDied","Data":"0fff0de9db5395822b561c7ab426a19e963a85c9b67588edfae142814f4be7c3"}
Jul 31 22:02:18.176130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.176098    2577 generic.go:356] "Generic (PLEG): container finished" podID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerID="55e1e26e4f8dcd679e30d369d59bf098a138143cc7d7054890e59019a60d8a1a" exitCode=0
Jul 31 22:02:18.176130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.176123    2577 generic.go:356] "Generic (PLEG): container finished" podID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerID="9df0464ab938ecf4431184b213aed2803f1dbc818e115e2a5298351071b0be99" exitCode=0
Jul 31 22:02:18.176539 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.176171    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerDied","Data":"55e1e26e4f8dcd679e30d369d59bf098a138143cc7d7054890e59019a60d8a1a"}
Jul 31 22:02:18.176539 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.176253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerDied","Data":"9df0464ab938ecf4431184b213aed2803f1dbc818e115e2a5298351071b0be99"}
Jul 31 22:02:18.213017 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.212994    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:18.388362 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388327    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-web-config\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388551 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388551 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388389    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbwtk\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-kube-api-access-tbwtk\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388551 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388410    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-metrics-client-ca\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388551 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388507    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388569    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-main-tls\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-cluster-tls-config\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388651    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-web\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-trusted-ca-bundle\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388705    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-tls-assets\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388744    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-out\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.388777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388771    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-main-db\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.389091 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388775    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:18.389091 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.388804    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-volume\") pod \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\" (UID: \"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6\") "
Jul 31 22:02:18.389091 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.389038    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-metrics-client-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.391714 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.391501    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-kube-api-access-tbwtk" (OuterVolumeSpecName: "kube-api-access-tbwtk") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "kube-api-access-tbwtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:02:18.391714 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.391585    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:18.392132 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.391774    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-volume" (OuterVolumeSpecName: "config-volume") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:18.392132 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.391918    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:18.392132 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.391922    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:02:18.392132 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.391978    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:02:18.392132 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.392021    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:18.392433 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.392282    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:18.393573 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.393549    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-out" (OuterVolumeSpecName: "config-out") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:02:18.394062 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.394037    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:18.395417 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.395393    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:18.402205 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.402166    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-web-config" (OuterVolumeSpecName: "web-config") pod "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" (UID: "3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:18.489469 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489431    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489469 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489461    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-main-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489475    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-cluster-tls-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489492    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489507    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489516    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-tls-assets\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489525    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-out\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489532    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-alertmanager-main-db\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489541    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489549    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-web-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489556    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:18.489671 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:18.489564    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbwtk\" (UniqueName: \"kubernetes.io/projected/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6-kube-api-access-tbwtk\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:19.182483 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.182429    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6","Type":"ContainerDied","Data":"99c1da6988d5c76a5aa582ceeb267193e8354602d958a780563c8aa7590ed7f9"}
Jul 31 22:02:19.182934 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.182494    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.182934 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.182566    2577 scope.go:117] "RemoveContainer" containerID="284f943dffa996c06c12a02ccd4e2827a9cbbd95b4df1720172752d52fe07cb7"
Jul 31 22:02:19.189892 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.189876    2577 scope.go:117] "RemoveContainer" containerID="55e1e26e4f8dcd679e30d369d59bf098a138143cc7d7054890e59019a60d8a1a"
Jul 31 22:02:19.196641 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.196626    2577 scope.go:117] "RemoveContainer" containerID="95e3d9374795d78cc6515fc193fded22202d032227d93f71b610573d5314b264"
Jul 31 22:02:19.203445 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.203406    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:02:19.203523 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.203472    2577 scope.go:117] "RemoveContainer" containerID="9df0464ab938ecf4431184b213aed2803f1dbc818e115e2a5298351071b0be99"
Jul 31 22:02:19.206632 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.206608    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:02:19.210354 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.210336    2577 scope.go:117] "RemoveContainer" containerID="777c02626b3154095a17c921eb386c9125fb8d9f93e56a6ffaa81afa6d81b415"
Jul 31 22:02:19.216778 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.216756    2577 scope.go:117] "RemoveContainer" containerID="0fff0de9db5395822b561c7ab426a19e963a85c9b67588edfae142814f4be7c3"
Jul 31 22:02:19.223502 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.223485    2577 scope.go:117] "RemoveContainer" containerID="9033b905dda7407b4136e46030938507af05389b0411076c99a995e9fa55ec70"
Jul 31 22:02:19.232045 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232027    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:02:19.232318 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232304    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy-web"
Jul 31 22:02:19.232366 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232319    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy-web"
Jul 31 22:02:19.232366 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232328    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e3efadc-fb7a-4ff0-8e5c-f53011549629" containerName="console"
Jul 31 22:02:19.232366 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232333    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e3efadc-fb7a-4ff0-8e5c-f53011549629" containerName="console"
Jul 31 22:02:19.232366 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232345    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="init-config-reloader"
Jul 31 22:02:19.232366 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232351    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="init-config-reloader"
Jul 31 22:02:19.232366 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232357    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="prom-label-proxy"
Jul 31 22:02:19.232366 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232362    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="prom-label-proxy"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232370    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232376    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232382    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="config-reloader"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232389    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="config-reloader"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232395    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy-metric"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232401    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy-metric"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232411    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6adb9307-e39b-4d7b-80d4-957a27fb3e01" containerName="console"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232416    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6adb9307-e39b-4d7b-80d4-957a27fb3e01" containerName="console"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232432    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="alertmanager"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232440    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="alertmanager"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232481    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6adb9307-e39b-4d7b-80d4-957a27fb3e01" containerName="console"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232488    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="prom-label-proxy"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232494    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy-metric"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232501    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="alertmanager"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232506    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e3efadc-fb7a-4ff0-8e5c-f53011549629" containerName="console"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232511    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232517    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="config-reloader"
Jul 31 22:02:19.232567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.232522    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" containerName="kube-rbac-proxy-web"
Jul 31 22:02:19.236246 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.236229    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.238884 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.238864    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 31 22:02:19.239009 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.238994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 31 22:02:19.239060 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.239002    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qjf54\""
Jul 31 22:02:19.239231 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.239218    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 31 22:02:19.239452 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.239434    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 31 22:02:19.239604 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.239590    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 31 22:02:19.239691 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.239674    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 31 22:02:19.239758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.239714    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 31 22:02:19.240033 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.240017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 31 22:02:19.244607 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.244587    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 31 22:02:19.253303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.253282    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:02:19.367363 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.367328    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5479fff965-vljng"]
Jul 31 22:02:19.369617 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.369571    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.386719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.386689    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5479fff965-vljng"]
Jul 31 22:02:19.394851 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.394828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.394982 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.394861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.394982 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.394897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.394982 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.394957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-config-volume\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395138 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.394981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395138 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.395008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395138 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.395042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395138 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.395109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395138 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.395134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395400 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.395160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395400 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.395218    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-web-config\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395400 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.395257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmptj\" (UniqueName: \"kubernetes.io/projected/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-kube-api-access-qmptj\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.395400 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.395293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-config-out\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.496517 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.496517 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.496771 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496537    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.496771 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-web-config\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.496771 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmptj\" (UniqueName: \"kubernetes.io/projected/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-kube-api-access-qmptj\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.496925 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-config-out\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.496925 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-oauth-serving-cert\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.496925 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.496925 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.497118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496936    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.497118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.496943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-trusted-ca-bundle\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.497118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.497118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-serving-cert\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.497118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfbb6\" (UniqueName: \"kubernetes.io/projected/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-kube-api-access-tfbb6\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.497382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497128    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-config-volume\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.497382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.497382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.497382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.497382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-oauth-config\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.497382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-service-ca\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.497382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.497323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-config\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.498313 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.498236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.498564 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.498538    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.499985 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.499940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-config-out\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.499985 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.499958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.500125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.500067    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.500292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.500256    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.500292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.500281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-web-config\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.500439 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.500362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.501191 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.501149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-config-volume\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.501465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.501445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.501661 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.501639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.504696 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.504673    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmptj\" (UniqueName: \"kubernetes.io/projected/bdd408ba-05bf-4175-800c-a77d5a9dd4c4-kube-api-access-qmptj\") pod \"alertmanager-main-0\" (UID: \"bdd408ba-05bf-4175-800c-a77d5a9dd4c4\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.546435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.546396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 22:02:19.598296 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.598264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-oauth-serving-cert\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.598438 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.598318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-trusted-ca-bundle\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.598438 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.598356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-serving-cert\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.598438 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.598382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfbb6\" (UniqueName: \"kubernetes.io/projected/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-kube-api-access-tfbb6\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.598590 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.598447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-oauth-config\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.598590 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.598474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-service-ca\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.598590 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.598522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-config\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.599275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.599210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-config\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.599371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.599353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-oauth-serving-cert\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.599448 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.599426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-service-ca\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.599487 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.599426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-trusted-ca-bundle\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.601778 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.601750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-oauth-config\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.602067 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.602032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-serving-cert\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.607519 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.607475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfbb6\" (UniqueName: \"kubernetes.io/projected/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-kube-api-access-tfbb6\") pod \"console-5479fff965-vljng\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") " pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.678121 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.678075    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:19.684961 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.684930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 22:02:19.688489 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:02:19.688460    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd408ba_05bf_4175_800c_a77d5a9dd4c4.slice/crio-e14a122afd725b382ab1f9c239b1ba0821f327ea6cd8f1bffe7b5177960ea2d7 WatchSource:0}: Error finding container e14a122afd725b382ab1f9c239b1ba0821f327ea6cd8f1bffe7b5177960ea2d7: Status 404 returned error can't find the container with id e14a122afd725b382ab1f9c239b1ba0821f327ea6cd8f1bffe7b5177960ea2d7
Jul 31 22:02:19.812554 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:19.812521    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5479fff965-vljng"]
Jul 31 22:02:19.839156 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:02:19.839121    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14bd67f9_a0db_4dd2_8e25_7f195b4ef3f4.slice/crio-a56b5c947ac8a5f953ef3e18837fa0cca03f812dbd7144a0d29a44570e9f10eb WatchSource:0}: Error finding container a56b5c947ac8a5f953ef3e18837fa0cca03f812dbd7144a0d29a44570e9f10eb: Status 404 returned error can't find the container with id a56b5c947ac8a5f953ef3e18837fa0cca03f812dbd7144a0d29a44570e9f10eb
Jul 31 22:02:20.187836 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:20.187748    2577 generic.go:356] "Generic (PLEG): container finished" podID="bdd408ba-05bf-4175-800c-a77d5a9dd4c4" containerID="652dd1b4379665133fb27455bf8dbd48a1686faec62813e0474578c328d1dc2a" exitCode=0
Jul 31 22:02:20.188334 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:20.187829    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bdd408ba-05bf-4175-800c-a77d5a9dd4c4","Type":"ContainerDied","Data":"652dd1b4379665133fb27455bf8dbd48a1686faec62813e0474578c328d1dc2a"}
Jul 31 22:02:20.188334 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:20.187906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bdd408ba-05bf-4175-800c-a77d5a9dd4c4","Type":"ContainerStarted","Data":"e14a122afd725b382ab1f9c239b1ba0821f327ea6cd8f1bffe7b5177960ea2d7"}
Jul 31 22:02:20.189594 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:20.189557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5479fff965-vljng" event={"ID":"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4","Type":"ContainerStarted","Data":"860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c"}
Jul 31 22:02:20.189707 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:20.189599    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5479fff965-vljng" event={"ID":"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4","Type":"ContainerStarted","Data":"a56b5c947ac8a5f953ef3e18837fa0cca03f812dbd7144a0d29a44570e9f10eb"}
Jul 31 22:02:20.233396 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:20.233350    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5479fff965-vljng" podStartSLOduration=1.23333446 podStartE2EDuration="1.23333446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:02:20.232478646 +0000 UTC m=+132.185564875" watchObservedRunningTime="2026-07-31 22:02:20.23333446 +0000 UTC m=+132.186420689"
Jul 31 22:02:20.531188 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:20.531148    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6" path="/var/lib/kubelet/pods/3fce72aa-90f5-45ef-9ff6-e892eaa9bdf6/volumes"
Jul 31 22:02:21.197246 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:21.197208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bdd408ba-05bf-4175-800c-a77d5a9dd4c4","Type":"ContainerStarted","Data":"7cb00b878f84dd94c030d09e762aed684184f9fcac75cfb22d39ad1c509176fa"}
Jul 31 22:02:21.197699 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:21.197295    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bdd408ba-05bf-4175-800c-a77d5a9dd4c4","Type":"ContainerStarted","Data":"c1434f3cedcb045e0f6d6de37ec58c1719facd7bde77e06f13aeab8cb3551b9e"}
Jul 31 22:02:21.197699 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:21.197327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bdd408ba-05bf-4175-800c-a77d5a9dd4c4","Type":"ContainerStarted","Data":"129b76097f03fbd77058b286cb9aba939afb0bece9e92425e7e4b1cce8e013da"}
Jul 31 22:02:21.197699 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:21.197357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bdd408ba-05bf-4175-800c-a77d5a9dd4c4","Type":"ContainerStarted","Data":"f43ec040e25d082a6dbee8940cabed3137e28b00c478064938c73e9e15912574"}
Jul 31 22:02:21.197699 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:21.197389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bdd408ba-05bf-4175-800c-a77d5a9dd4c4","Type":"ContainerStarted","Data":"4c49d7042f0b3a871b46835802385e0b4ebd4387b0b2bd4a8b28d7d832fb105a"}
Jul 31 22:02:21.197699 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:21.197413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bdd408ba-05bf-4175-800c-a77d5a9dd4c4","Type":"ContainerStarted","Data":"e4c04b74e99758b4b092ed0c2dc9e2b9a5f34c28312809f3e2412017d046b72e"}
Jul 31 22:02:21.225859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:21.225804    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.210532064 podStartE2EDuration="2.225788267s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.256203ms" isStatefulPod=false podCreationTimestamp="2026-07-31 22:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:02:21.223743475 +0000 UTC m=+133.176829698" watchObservedRunningTime="2026-07-31 22:02:21.225788267 +0000 UTC m=+133.178874496"
Jul 31 22:02:29.679151 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:29.679113    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:29.679610 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:29.679208    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:29.683885 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:29.683865    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:30.238207 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:30.238166    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:02:30.295832 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:30.295804    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb6559b46-vmxns"]
Jul 31 22:02:55.315060 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.314992    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cb6559b46-vmxns" podUID="5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" containerName="console" containerID="cri-o://eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151" gracePeriod=15
Jul 31 22:02:55.549956 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.549934    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:02:55.606116 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606087    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-oauth-config\") pod \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") "
Jul 31 22:02:55.606323 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606141    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-config\") pod \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") "
Jul 31 22:02:55.606323 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606213    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-oauth-serving-cert\") pod \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") "
Jul 31 22:02:55.606323 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606240    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-trusted-ca-bundle\") pod \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") "
Jul 31 22:02:55.606323 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606267    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kjr9\" (UniqueName: \"kubernetes.io/projected/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-kube-api-access-4kjr9\") pod \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") "
Jul 31 22:02:55.606323 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606282    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-serving-cert\") pod \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") "
Jul 31 22:02:55.606323 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606308    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-service-ca\") pod \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\" (UID: \"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6\") "
Jul 31 22:02:55.606630 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606521    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-config" (OuterVolumeSpecName: "console-config") pod "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" (UID: "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:55.606760 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606732    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" (UID: "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:55.606816 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606766    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" (UID: "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:55.606816 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.606775    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" (UID: "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:55.608491 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.608463    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" (UID: "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:55.608610 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.608574    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" (UID: "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:55.608610 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.608584    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-kube-api-access-4kjr9" (OuterVolumeSpecName: "kube-api-access-4kjr9") pod "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" (UID: "5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6"). InnerVolumeSpecName "kube-api-access-4kjr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:02:55.707830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.707790    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-oauth-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:55.707830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.707822    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:55.707830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.707832    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-oauth-serving-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:55.707830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.707841    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-trusted-ca-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:55.708099 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.707851    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kjr9\" (UniqueName: \"kubernetes.io/projected/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-kube-api-access-4kjr9\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:55.708099 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.707860    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-console-serving-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:55.708099 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:55.707868    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:02:56.330602 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.330567    2577 generic.go:356] "Generic (PLEG): container finished" podID="5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" containerID="eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151" exitCode=0
Jul 31 22:02:56.331009 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.330615    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb6559b46-vmxns"
Jul 31 22:02:56.331009 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.330657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb6559b46-vmxns" event={"ID":"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6","Type":"ContainerDied","Data":"eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151"}
Jul 31 22:02:56.331009 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.330715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb6559b46-vmxns" event={"ID":"5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6","Type":"ContainerDied","Data":"a5fb32498c700f2065301b80980ba4f35d256f6278d690f9bc9cecb7bd8203ac"}
Jul 31 22:02:56.331009 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.330736    2577 scope.go:117] "RemoveContainer" containerID="eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151"
Jul 31 22:02:56.338961 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.338943    2577 scope.go:117] "RemoveContainer" containerID="eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151"
Jul 31 22:02:56.339229 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:02:56.339208    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151\": container with ID starting with eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151 not found: ID does not exist" containerID="eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151"
Jul 31 22:02:56.339307 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.339238    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151"} err="failed to get container status \"eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151\": rpc error: code = NotFound desc = could not find container \"eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151\": container with ID starting with eb111ad9b653460b31909d624bee34fdb73c70b02684f19bef9caaa662ef8151 not found: ID does not exist"
Jul 31 22:02:56.353443 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.353417    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb6559b46-vmxns"]
Jul 31 22:02:56.355792 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.355772    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cb6559b46-vmxns"]
Jul 31 22:02:56.531278 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:02:56.531235    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" path="/var/lib/kubelet/pods/5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6/volumes"
Jul 31 22:03:31.919132 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.919094    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"]
Jul 31 22:03:31.919631 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.919435    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" containerName="console"
Jul 31 22:03:31.919631 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.919448    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" containerName="console"
Jul 31 22:03:31.919631 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.919500    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6e40ac-6ecd-4ec4-9cf1-7610b0f920d6" containerName="console"
Jul 31 22:03:31.922448 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.922433    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:31.925047 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.925027    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 22:03:31.925188 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.925070    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hwmps\""
Jul 31 22:03:31.925854 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.925837    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 22:03:31.930841 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:31.930819    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"]
Jul 31 22:03:32.001853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.001815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.001853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.001852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.002073 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.001888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk5r4\" (UniqueName: \"kubernetes.io/projected/95bca86c-4547-479e-bb72-d69a3eae4a3e-kube-api-access-bk5r4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.103250 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.103220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.103344 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.103259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.103344 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.103294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk5r4\" (UniqueName: \"kubernetes.io/projected/95bca86c-4547-479e-bb72-d69a3eae4a3e-kube-api-access-bk5r4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.103699 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.103676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.103738 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.103685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.111840 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.111812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk5r4\" (UniqueName: \"kubernetes.io/projected/95bca86c-4547-479e-bb72-d69a3eae4a3e-kube-api-access-bk5r4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.231808 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.231721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:32.360814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.360782    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"]
Jul 31 22:03:32.363596 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:03:32.363570    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bca86c_4547_479e_bb72_d69a3eae4a3e.slice/crio-cba815c0d08b70bd3f88f3468f57a08c7262524688f4babb87f94930bda953c0 WatchSource:0}: Error finding container cba815c0d08b70bd3f88f3468f57a08c7262524688f4babb87f94930bda953c0: Status 404 returned error can't find the container with id cba815c0d08b70bd3f88f3468f57a08c7262524688f4babb87f94930bda953c0
Jul 31 22:03:32.468318 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:32.468281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4" event={"ID":"95bca86c-4547-479e-bb72-d69a3eae4a3e","Type":"ContainerStarted","Data":"cba815c0d08b70bd3f88f3468f57a08c7262524688f4babb87f94930bda953c0"}
Jul 31 22:03:39.499383 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:39.499345    2577 generic.go:356] "Generic (PLEG): container finished" podID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerID="85d3f0de6c119bdbd1dc69fe02c6a48f22e6cb8c3de15f55273afe2b1cd09e98" exitCode=0
Jul 31 22:03:39.499776 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:39.499435    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4" event={"ID":"95bca86c-4547-479e-bb72-d69a3eae4a3e","Type":"ContainerDied","Data":"85d3f0de6c119bdbd1dc69fe02c6a48f22e6cb8c3de15f55273afe2b1cd09e98"}
Jul 31 22:03:42.513124 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:42.513086    2577 generic.go:356] "Generic (PLEG): container finished" podID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerID="fa206640eaaecccb09a68a453d14732f39972fc22c6f7566224fa81cbdd39fdc" exitCode=0
Jul 31 22:03:42.513498 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:42.513192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4" event={"ID":"95bca86c-4547-479e-bb72-d69a3eae4a3e","Type":"ContainerDied","Data":"fa206640eaaecccb09a68a453d14732f39972fc22c6f7566224fa81cbdd39fdc"}
Jul 31 22:03:49.544555 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:49.544516    2577 generic.go:356] "Generic (PLEG): container finished" podID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerID="99b35bb805598af3c8ff7ff6bf3aeae67a58e25ec6e48c751a6f8ebf61c5ca51" exitCode=0
Jul 31 22:03:49.544955 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:49.544604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4" event={"ID":"95bca86c-4547-479e-bb72-d69a3eae4a3e","Type":"ContainerDied","Data":"99b35bb805598af3c8ff7ff6bf3aeae67a58e25ec6e48c751a6f8ebf61c5ca51"}
Jul 31 22:03:50.677192 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.677152    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:50.765122 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.765083    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-bundle\") pod \"95bca86c-4547-479e-bb72-d69a3eae4a3e\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") "
Jul 31 22:03:50.765311 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.765157    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk5r4\" (UniqueName: \"kubernetes.io/projected/95bca86c-4547-479e-bb72-d69a3eae4a3e-kube-api-access-bk5r4\") pod \"95bca86c-4547-479e-bb72-d69a3eae4a3e\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") "
Jul 31 22:03:50.765311 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.765204    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-util\") pod \"95bca86c-4547-479e-bb72-d69a3eae4a3e\" (UID: \"95bca86c-4547-479e-bb72-d69a3eae4a3e\") "
Jul 31 22:03:50.765959 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.765924    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-bundle" (OuterVolumeSpecName: "bundle") pod "95bca86c-4547-479e-bb72-d69a3eae4a3e" (UID: "95bca86c-4547-479e-bb72-d69a3eae4a3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:03:50.767319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.767288    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95bca86c-4547-479e-bb72-d69a3eae4a3e-kube-api-access-bk5r4" (OuterVolumeSpecName: "kube-api-access-bk5r4") pod "95bca86c-4547-479e-bb72-d69a3eae4a3e" (UID: "95bca86c-4547-479e-bb72-d69a3eae4a3e"). InnerVolumeSpecName "kube-api-access-bk5r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:03:50.769830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.769808    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-util" (OuterVolumeSpecName: "util") pod "95bca86c-4547-479e-bb72-d69a3eae4a3e" (UID: "95bca86c-4547-479e-bb72-d69a3eae4a3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:03:50.866719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.866677    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:03:50.866719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.866712    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk5r4\" (UniqueName: \"kubernetes.io/projected/95bca86c-4547-479e-bb72-d69a3eae4a3e-kube-api-access-bk5r4\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:03:50.866719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:50.866721    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95bca86c-4547-479e-bb72-d69a3eae4a3e-util\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:03:51.553644 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:51.553612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4" event={"ID":"95bca86c-4547-479e-bb72-d69a3eae4a3e","Type":"ContainerDied","Data":"cba815c0d08b70bd3f88f3468f57a08c7262524688f4babb87f94930bda953c0"}
Jul 31 22:03:51.553813 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:51.553663    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cba815c0d08b70bd3f88f3468f57a08c7262524688f4babb87f94930bda953c0"
Jul 31 22:03:51.553813 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:51.553618    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xwps4"
Jul 31 22:03:55.073519 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.073484    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"]
Jul 31 22:03:55.073897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.073785    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerName="extract"
Jul 31 22:03:55.073897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.073795    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerName="extract"
Jul 31 22:03:55.073897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.073822    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerName="util"
Jul 31 22:03:55.073897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.073827    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerName="util"
Jul 31 22:03:55.073897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.073834    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerName="pull"
Jul 31 22:03:55.073897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.073839    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerName="pull"
Jul 31 22:03:55.073897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.073883    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="95bca86c-4547-479e-bb72-d69a3eae4a3e" containerName="extract"
Jul 31 22:03:55.106224 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.106191    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"]
Jul 31 22:03:55.106367 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.106301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"
Jul 31 22:03:55.108816 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.108798    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5np7t\""
Jul 31 22:03:55.108919 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.108862    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 31 22:03:55.109119 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.109102    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 31 22:03:55.202528 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.202485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsqwb\" (UniqueName: \"kubernetes.io/projected/94bd8106-af13-4329-a881-66ded953f9a3-kube-api-access-xsqwb\") pod \"cert-manager-operator-controller-manager-55c444bf86-zxwdl\" (UID: \"94bd8106-af13-4329-a881-66ded953f9a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"
Jul 31 22:03:55.202699 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.202561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94bd8106-af13-4329-a881-66ded953f9a3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zxwdl\" (UID: \"94bd8106-af13-4329-a881-66ded953f9a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"
Jul 31 22:03:55.303489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.303449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94bd8106-af13-4329-a881-66ded953f9a3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zxwdl\" (UID: \"94bd8106-af13-4329-a881-66ded953f9a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"
Jul 31 22:03:55.303688 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.303520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsqwb\" (UniqueName: \"kubernetes.io/projected/94bd8106-af13-4329-a881-66ded953f9a3-kube-api-access-xsqwb\") pod \"cert-manager-operator-controller-manager-55c444bf86-zxwdl\" (UID: \"94bd8106-af13-4329-a881-66ded953f9a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"
Jul 31 22:03:55.303896 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.303873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94bd8106-af13-4329-a881-66ded953f9a3-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zxwdl\" (UID: \"94bd8106-af13-4329-a881-66ded953f9a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"
Jul 31 22:03:55.313083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.313050    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsqwb\" (UniqueName: \"kubernetes.io/projected/94bd8106-af13-4329-a881-66ded953f9a3-kube-api-access-xsqwb\") pod \"cert-manager-operator-controller-manager-55c444bf86-zxwdl\" (UID: \"94bd8106-af13-4329-a881-66ded953f9a3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"
Jul 31 22:03:55.415550 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.415519    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"
Jul 31 22:03:55.567408 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:55.567379    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl"]
Jul 31 22:03:55.570019 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:03:55.569988    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bd8106_af13_4329_a881_66ded953f9a3.slice/crio-2246e85a2757597e914b8ade2bdc7278f37514a40e06762b9a768bd16b668786 WatchSource:0}: Error finding container 2246e85a2757597e914b8ade2bdc7278f37514a40e06762b9a768bd16b668786: Status 404 returned error can't find the container with id 2246e85a2757597e914b8ade2bdc7278f37514a40e06762b9a768bd16b668786
Jul 31 22:03:56.575928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:56.575889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl" event={"ID":"94bd8106-af13-4329-a881-66ded953f9a3","Type":"ContainerStarted","Data":"2246e85a2757597e914b8ade2bdc7278f37514a40e06762b9a768bd16b668786"}
Jul 31 22:03:57.582954 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:57.582918    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl" event={"ID":"94bd8106-af13-4329-a881-66ded953f9a3","Type":"ContainerStarted","Data":"40c0d1ae435cc2b34a9866041cb37ad83ebb8f7ebd99d56dd90395fcbd44b229"}
Jul 31 22:03:57.625963 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:57.625902    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zxwdl" podStartSLOduration=0.931050801 podStartE2EDuration="2.625887547s" totalImagesPullingTime="1.694836746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:03:57.624867101 +0000 UTC m=+229.577953330" watchObservedRunningTime="2026-07-31 22:03:57.625887547 +0000 UTC m=+229.578973775"
Jul 31 22:03:58.682084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.682051    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"]
Jul 31 22:03:58.684340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.684324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.686895 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.686867    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 22:03:58.686895 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.686882    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 22:03:58.687081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.686904    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hwmps\""
Jul 31 22:03:58.700153 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.700123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"]
Jul 31 22:03:58.834336 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.834303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.834480 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.834345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98fct\" (UniqueName: \"kubernetes.io/projected/354b466f-f359-4ab7-a99a-0fde4f7434d1-kube-api-access-98fct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.834480 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.834396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.935719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.935639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.935719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.935675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fct\" (UniqueName: \"kubernetes.io/projected/354b466f-f359-4ab7-a99a-0fde4f7434d1-kube-api-access-98fct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.935719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.935696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.936043 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.936022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.936104 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.936087    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.946310 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.946284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98fct\" (UniqueName: \"kubernetes.io/projected/354b466f-f359-4ab7-a99a-0fde4f7434d1-kube-api-access-98fct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:58.993083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:58.993043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:03:59.134852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:59.134824    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"]
Jul 31 22:03:59.136715 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:03:59.136686    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354b466f_f359_4ab7_a99a_0fde4f7434d1.slice/crio-68ad138a4ee1ebf0049f781972760008742726ac4d27b29b6cda06d15e734675 WatchSource:0}: Error finding container 68ad138a4ee1ebf0049f781972760008742726ac4d27b29b6cda06d15e734675: Status 404 returned error can't find the container with id 68ad138a4ee1ebf0049f781972760008742726ac4d27b29b6cda06d15e734675
Jul 31 22:03:59.592218 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:59.592159    2577 generic.go:356] "Generic (PLEG): container finished" podID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerID="eff740b2b8ec04f883f4c460fc56746d52ccc149a41929f5490955e638641381" exitCode=0
Jul 31 22:03:59.592382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:59.592231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268" event={"ID":"354b466f-f359-4ab7-a99a-0fde4f7434d1","Type":"ContainerDied","Data":"eff740b2b8ec04f883f4c460fc56746d52ccc149a41929f5490955e638641381"}
Jul 31 22:03:59.592382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:03:59.592282    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268" event={"ID":"354b466f-f359-4ab7-a99a-0fde4f7434d1","Type":"ContainerStarted","Data":"68ad138a4ee1ebf0049f781972760008742726ac4d27b29b6cda06d15e734675"}
Jul 31 22:04:01.450888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.450848    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"]
Jul 31 22:04:01.457353 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.457327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"
Jul 31 22:04:01.461460 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.461431    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 31 22:04:01.461623 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.461537    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 31 22:04:01.462379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.462355    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lkrsg\""
Jul 31 22:04:01.470798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.470769    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"]
Jul 31 22:04:01.560211 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.560160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8s28\" (UniqueName: \"kubernetes.io/projected/244c77d6-16d9-490b-b139-96d93af7834f-kube-api-access-h8s28\") pod \"cert-manager-cainjector-559cdd8c87-f2zl2\" (UID: \"244c77d6-16d9-490b-b139-96d93af7834f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"
Jul 31 22:04:01.560427 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.560221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/244c77d6-16d9-490b-b139-96d93af7834f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f2zl2\" (UID: \"244c77d6-16d9-490b-b139-96d93af7834f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"
Jul 31 22:04:01.661489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.661446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8s28\" (UniqueName: \"kubernetes.io/projected/244c77d6-16d9-490b-b139-96d93af7834f-kube-api-access-h8s28\") pod \"cert-manager-cainjector-559cdd8c87-f2zl2\" (UID: \"244c77d6-16d9-490b-b139-96d93af7834f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"
Jul 31 22:04:01.661489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.661485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/244c77d6-16d9-490b-b139-96d93af7834f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f2zl2\" (UID: \"244c77d6-16d9-490b-b139-96d93af7834f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"
Jul 31 22:04:01.672410 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.672379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/244c77d6-16d9-490b-b139-96d93af7834f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-f2zl2\" (UID: \"244c77d6-16d9-490b-b139-96d93af7834f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"
Jul 31 22:04:01.675835 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.675804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8s28\" (UniqueName: \"kubernetes.io/projected/244c77d6-16d9-490b-b139-96d93af7834f-kube-api-access-h8s28\") pod \"cert-manager-cainjector-559cdd8c87-f2zl2\" (UID: \"244c77d6-16d9-490b-b139-96d93af7834f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"
Jul 31 22:04:01.780652 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.780612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"
Jul 31 22:04:01.917569 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:01.917469    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2"]
Jul 31 22:04:01.920040 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:04:01.920012    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod244c77d6_16d9_490b_b139_96d93af7834f.slice/crio-b0dc3ae78aa378c11cc684a889f0a5c1e7a4b5dfc69f74bd640511437661e7b8 WatchSource:0}: Error finding container b0dc3ae78aa378c11cc684a889f0a5c1e7a4b5dfc69f74bd640511437661e7b8: Status 404 returned error can't find the container with id b0dc3ae78aa378c11cc684a889f0a5c1e7a4b5dfc69f74bd640511437661e7b8
Jul 31 22:04:02.607074 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:02.607029    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2" event={"ID":"244c77d6-16d9-490b-b139-96d93af7834f","Type":"ContainerStarted","Data":"b0dc3ae78aa378c11cc684a889f0a5c1e7a4b5dfc69f74bd640511437661e7b8"}
Jul 31 22:04:02.608767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:02.608741    2577 generic.go:356] "Generic (PLEG): container finished" podID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerID="2001ae548a61d90cac16e432f582c0b105f38dc08ba725981f6f1ae08f5228c4" exitCode=0
Jul 31 22:04:02.608871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:02.608804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268" event={"ID":"354b466f-f359-4ab7-a99a-0fde4f7434d1","Type":"ContainerDied","Data":"2001ae548a61d90cac16e432f582c0b105f38dc08ba725981f6f1ae08f5228c4"}
Jul 31 22:04:03.616614 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:03.616578    2577 generic.go:356] "Generic (PLEG): container finished" podID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerID="656478d59866911c449715c27acf5cb87a1b39b56233ce12303428351c1d6d75" exitCode=0
Jul 31 22:04:03.617230 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:03.616659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268" event={"ID":"354b466f-f359-4ab7-a99a-0fde4f7434d1","Type":"ContainerDied","Data":"656478d59866911c449715c27acf5cb87a1b39b56233ce12303428351c1d6d75"}
Jul 31 22:04:04.750560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.750520    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:04:04.893007 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.892919    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-bundle\") pod \"354b466f-f359-4ab7-a99a-0fde4f7434d1\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") "
Jul 31 22:04:04.893007 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.892980    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98fct\" (UniqueName: \"kubernetes.io/projected/354b466f-f359-4ab7-a99a-0fde4f7434d1-kube-api-access-98fct\") pod \"354b466f-f359-4ab7-a99a-0fde4f7434d1\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") "
Jul 31 22:04:04.893279 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.893045    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-util\") pod \"354b466f-f359-4ab7-a99a-0fde4f7434d1\" (UID: \"354b466f-f359-4ab7-a99a-0fde4f7434d1\") "
Jul 31 22:04:04.893406 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.893377    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-bundle" (OuterVolumeSpecName: "bundle") pod "354b466f-f359-4ab7-a99a-0fde4f7434d1" (UID: "354b466f-f359-4ab7-a99a-0fde4f7434d1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:04:04.895251 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.895226    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/354b466f-f359-4ab7-a99a-0fde4f7434d1-kube-api-access-98fct" (OuterVolumeSpecName: "kube-api-access-98fct") pod "354b466f-f359-4ab7-a99a-0fde4f7434d1" (UID: "354b466f-f359-4ab7-a99a-0fde4f7434d1"). InnerVolumeSpecName "kube-api-access-98fct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:04:04.898059 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.898035    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-util" (OuterVolumeSpecName: "util") pod "354b466f-f359-4ab7-a99a-0fde4f7434d1" (UID: "354b466f-f359-4ab7-a99a-0fde4f7434d1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:04:04.994654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.994614    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-util\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:04:04.994654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.994650    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/354b466f-f359-4ab7-a99a-0fde4f7434d1-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:04:04.994856 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:04.994664    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98fct\" (UniqueName: \"kubernetes.io/projected/354b466f-f359-4ab7-a99a-0fde4f7434d1-kube-api-access-98fct\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:04:05.626815 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:05.626752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2" event={"ID":"244c77d6-16d9-490b-b139-96d93af7834f","Type":"ContainerStarted","Data":"67f158657980488f4fe444e2f963fb03ef53715bcd580ef12c98e0ef31930726"}
Jul 31 22:04:05.628667 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:05.628642    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268" event={"ID":"354b466f-f359-4ab7-a99a-0fde4f7434d1","Type":"ContainerDied","Data":"68ad138a4ee1ebf0049f781972760008742726ac4d27b29b6cda06d15e734675"}
Jul 31 22:04:05.628799 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:05.628681    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68ad138a4ee1ebf0049f781972760008742726ac4d27b29b6cda06d15e734675"
Jul 31 22:04:05.628799 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:05.628684    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgt268"
Jul 31 22:04:05.646002 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:05.645959    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-f2zl2" podStartSLOduration=1.886863932 podStartE2EDuration="4.645937773s" totalImagesPullingTime="2.759073841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:05.645797519 +0000 UTC m=+237.598883752" watchObservedRunningTime="2026-07-31 22:04:05.645937773 +0000 UTC m=+237.599024001"
Jul 31 22:04:06.514825 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.514779    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l8flk"]
Jul 31 22:04:06.515340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.515236    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerName="util"
Jul 31 22:04:06.515340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.515255    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerName="util"
Jul 31 22:04:06.515340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.515275    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerName="extract"
Jul 31 22:04:06.515340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.515283    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerName="extract"
Jul 31 22:04:06.515340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.515296    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerName="pull"
Jul 31 22:04:06.515340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.515304    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerName="pull"
Jul 31 22:04:06.515646 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.515395    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="354b466f-f359-4ab7-a99a-0fde4f7434d1" containerName="extract"
Jul 31 22:04:06.517285 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.517263    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:06.520027 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.520010    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-85wsc\""
Jul 31 22:04:06.532335 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.532314    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l8flk"]
Jul 31 22:04:06.710774 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.710741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60ce092c-3c4c-4b0c-af0f-8e0f7c404f50-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l8flk\" (UID: \"60ce092c-3c4c-4b0c-af0f-8e0f7c404f50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:06.710935 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.710812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l99wk\" (UniqueName: \"kubernetes.io/projected/60ce092c-3c4c-4b0c-af0f-8e0f7c404f50-kube-api-access-l99wk\") pod \"cert-manager-webhook-6486ffd997-l8flk\" (UID: \"60ce092c-3c4c-4b0c-af0f-8e0f7c404f50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:06.811931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.811844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l99wk\" (UniqueName: \"kubernetes.io/projected/60ce092c-3c4c-4b0c-af0f-8e0f7c404f50-kube-api-access-l99wk\") pod \"cert-manager-webhook-6486ffd997-l8flk\" (UID: \"60ce092c-3c4c-4b0c-af0f-8e0f7c404f50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:06.811931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.811921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60ce092c-3c4c-4b0c-af0f-8e0f7c404f50-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l8flk\" (UID: \"60ce092c-3c4c-4b0c-af0f-8e0f7c404f50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:06.823202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.823151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60ce092c-3c4c-4b0c-af0f-8e0f7c404f50-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-l8flk\" (UID: \"60ce092c-3c4c-4b0c-af0f-8e0f7c404f50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:06.823202 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.823192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l99wk\" (UniqueName: \"kubernetes.io/projected/60ce092c-3c4c-4b0c-af0f-8e0f7c404f50-kube-api-access-l99wk\") pod \"cert-manager-webhook-6486ffd997-l8flk\" (UID: \"60ce092c-3c4c-4b0c-af0f-8e0f7c404f50\") " pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:06.825981 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.825955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:06.960351 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:06.960313    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-l8flk"]
Jul 31 22:04:06.964725 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:04:06.964694    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60ce092c_3c4c_4b0c_af0f_8e0f7c404f50.slice/crio-7ee037985532ebf7bac5d8a0b8e375055159891e12bc06df16e5b2fb8b29b3ff WatchSource:0}: Error finding container 7ee037985532ebf7bac5d8a0b8e375055159891e12bc06df16e5b2fb8b29b3ff: Status 404 returned error can't find the container with id 7ee037985532ebf7bac5d8a0b8e375055159891e12bc06df16e5b2fb8b29b3ff
Jul 31 22:04:07.639240 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:07.639201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk" event={"ID":"60ce092c-3c4c-4b0c-af0f-8e0f7c404f50","Type":"ContainerStarted","Data":"5ef3511dbabd3abbeb10689e4b4e05bed28f4ea2930067dd40e866be3403294d"}
Jul 31 22:04:07.639240 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:07.639245    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk" event={"ID":"60ce092c-3c4c-4b0c-af0f-8e0f7c404f50","Type":"ContainerStarted","Data":"7ee037985532ebf7bac5d8a0b8e375055159891e12bc06df16e5b2fb8b29b3ff"}
Jul 31 22:04:07.639658 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:07.639350    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:07.660056 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:07.660002    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk" podStartSLOduration=1.659985705 podStartE2EDuration="1.659985705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:07.657525233 +0000 UTC m=+239.610611462" watchObservedRunningTime="2026-07-31 22:04:07.659985705 +0000 UTC m=+239.613071923"
Jul 31 22:04:09.693929 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.693891    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q77mh"]
Jul 31 22:04:09.696591 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.696574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-q77mh"
Jul 31 22:04:09.699131 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.699107    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gqj9x\""
Jul 31 22:04:09.706087 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.706061    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q77mh"]
Jul 31 22:04:09.736909 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.736875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94gdn\" (UniqueName: \"kubernetes.io/projected/066ebf1d-8e1a-4309-95be-4b538fe20d56-kube-api-access-94gdn\") pod \"cert-manager-55b4d954d5-q77mh\" (UID: \"066ebf1d-8e1a-4309-95be-4b538fe20d56\") " pod="cert-manager/cert-manager-55b4d954d5-q77mh"
Jul 31 22:04:09.737075 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.736931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/066ebf1d-8e1a-4309-95be-4b538fe20d56-bound-sa-token\") pod \"cert-manager-55b4d954d5-q77mh\" (UID: \"066ebf1d-8e1a-4309-95be-4b538fe20d56\") " pod="cert-manager/cert-manager-55b4d954d5-q77mh"
Jul 31 22:04:09.837920 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.837887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/066ebf1d-8e1a-4309-95be-4b538fe20d56-bound-sa-token\") pod \"cert-manager-55b4d954d5-q77mh\" (UID: \"066ebf1d-8e1a-4309-95be-4b538fe20d56\") " pod="cert-manager/cert-manager-55b4d954d5-q77mh"
Jul 31 22:04:09.838091 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.837956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94gdn\" (UniqueName: \"kubernetes.io/projected/066ebf1d-8e1a-4309-95be-4b538fe20d56-kube-api-access-94gdn\") pod \"cert-manager-55b4d954d5-q77mh\" (UID: \"066ebf1d-8e1a-4309-95be-4b538fe20d56\") " pod="cert-manager/cert-manager-55b4d954d5-q77mh"
Jul 31 22:04:09.846789 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.846764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94gdn\" (UniqueName: \"kubernetes.io/projected/066ebf1d-8e1a-4309-95be-4b538fe20d56-kube-api-access-94gdn\") pod \"cert-manager-55b4d954d5-q77mh\" (UID: \"066ebf1d-8e1a-4309-95be-4b538fe20d56\") " pod="cert-manager/cert-manager-55b4d954d5-q77mh"
Jul 31 22:04:09.846916 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:09.846811    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/066ebf1d-8e1a-4309-95be-4b538fe20d56-bound-sa-token\") pod \"cert-manager-55b4d954d5-q77mh\" (UID: \"066ebf1d-8e1a-4309-95be-4b538fe20d56\") " pod="cert-manager/cert-manager-55b4d954d5-q77mh"
Jul 31 22:04:10.005927 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:10.005839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-q77mh"
Jul 31 22:04:10.156238 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:10.156204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q77mh"]
Jul 31 22:04:10.159769 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:04:10.159743    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod066ebf1d_8e1a_4309_95be_4b538fe20d56.slice/crio-712316c1522f86cb1aa0ccb9fb11d9a49d32eb008ad4155b11547ae5e8f88d0a WatchSource:0}: Error finding container 712316c1522f86cb1aa0ccb9fb11d9a49d32eb008ad4155b11547ae5e8f88d0a: Status 404 returned error can't find the container with id 712316c1522f86cb1aa0ccb9fb11d9a49d32eb008ad4155b11547ae5e8f88d0a
Jul 31 22:04:10.653979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:10.653938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-q77mh" event={"ID":"066ebf1d-8e1a-4309-95be-4b538fe20d56","Type":"ContainerStarted","Data":"f492456e6f0d6b9a77b079256cd4dc36687ecb422a2e0d3fc4e53678eec78045"}
Jul 31 22:04:10.653979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:10.653985    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-q77mh" event={"ID":"066ebf1d-8e1a-4309-95be-4b538fe20d56","Type":"ContainerStarted","Data":"712316c1522f86cb1aa0ccb9fb11d9a49d32eb008ad4155b11547ae5e8f88d0a"}
Jul 31 22:04:10.673706 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:10.673656    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-q77mh" podStartSLOduration=1.6736386049999998 podStartE2EDuration="1.673638605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:10.67306719 +0000 UTC m=+242.626153418" watchObservedRunningTime="2026-07-31 22:04:10.673638605 +0000 UTC m=+242.626724833"
Jul 31 22:04:13.646097 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:13.646069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-l8flk"
Jul 31 22:04:18.331006 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.330969    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"]
Jul 31 22:04:18.333642 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.333623    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.336553 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.336526    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 22:04:18.337275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.337256    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 22:04:18.337389 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.337256    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hwmps\""
Jul 31 22:04:18.347360 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.347340    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"]
Jul 31 22:04:18.414514 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.414474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.414680 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.414542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.414680 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.414563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfdg8\" (UniqueName: \"kubernetes.io/projected/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-kube-api-access-hfdg8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.514956 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.514922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.515154 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.514964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfdg8\" (UniqueName: \"kubernetes.io/projected/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-kube-api-access-hfdg8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.515154 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.515014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.515374 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.515354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.515449 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.515385    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.527300 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.527271    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfdg8\" (UniqueName: \"kubernetes.io/projected/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-kube-api-access-hfdg8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.642688 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.642605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:18.769956 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:18.769927    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"]
Jul 31 22:04:18.772579 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:04:18.772545    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d0b064_47e6_4c5e_86f1_d3c9499ebbdf.slice/crio-b79b6847e7f13201784197f35cf68d8806f12601f0afa38940dd8a95c7367adf WatchSource:0}: Error finding container b79b6847e7f13201784197f35cf68d8806f12601f0afa38940dd8a95c7367adf: Status 404 returned error can't find the container with id b79b6847e7f13201784197f35cf68d8806f12601f0afa38940dd8a95c7367adf
Jul 31 22:04:19.694756 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:19.694721    2577 generic.go:356] "Generic (PLEG): container finished" podID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerID="29630b3037221ea9db88be8e01497ebd59ab1ddeaa974fea864120cd25a4e3bc" exitCode=0
Jul 31 22:04:19.695145 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:19.694810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4" event={"ID":"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf","Type":"ContainerDied","Data":"29630b3037221ea9db88be8e01497ebd59ab1ddeaa974fea864120cd25a4e3bc"}
Jul 31 22:04:19.695145 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:19.694864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4" event={"ID":"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf","Type":"ContainerStarted","Data":"b79b6847e7f13201784197f35cf68d8806f12601f0afa38940dd8a95c7367adf"}
Jul 31 22:04:20.700408 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:20.700372    2577 generic.go:356] "Generic (PLEG): container finished" podID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerID="985a9cb1737914b89faa32b87a8ebade7cda7d8897b7a9583df3c6a1f066a047" exitCode=0
Jul 31 22:04:20.700829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:20.700450    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4" event={"ID":"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf","Type":"ContainerDied","Data":"985a9cb1737914b89faa32b87a8ebade7cda7d8897b7a9583df3c6a1f066a047"}
Jul 31 22:04:21.707129 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:21.707096    2577 generic.go:356] "Generic (PLEG): container finished" podID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerID="4a053301bd4aefd479bcd18254c79b549ca7eb3604a86c8adb6ca721b4cc403c" exitCode=0
Jul 31 22:04:21.707542 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:21.707199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4" event={"ID":"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf","Type":"ContainerDied","Data":"4a053301bd4aefd479bcd18254c79b549ca7eb3604a86c8adb6ca721b4cc403c"}
Jul 31 22:04:22.852114 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:22.852077    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:22.950642 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:22.950608    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-bundle\") pod \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") "
Jul 31 22:04:22.950822 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:22.950658    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfdg8\" (UniqueName: \"kubernetes.io/projected/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-kube-api-access-hfdg8\") pod \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") "
Jul 31 22:04:22.950822 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:22.950718    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-util\") pod \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\" (UID: \"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf\") "
Jul 31 22:04:22.951385 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:22.951357    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-bundle" (OuterVolumeSpecName: "bundle") pod "d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" (UID: "d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:04:22.952790 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:22.952771    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-kube-api-access-hfdg8" (OuterVolumeSpecName: "kube-api-access-hfdg8") pod "d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" (UID: "d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf"). InnerVolumeSpecName "kube-api-access-hfdg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:04:22.956687 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:22.956640    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-util" (OuterVolumeSpecName: "util") pod "d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" (UID: "d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:04:23.051489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:23.051400    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:04:23.051489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:23.051434    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfdg8\" (UniqueName: \"kubernetes.io/projected/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-kube-api-access-hfdg8\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:04:23.051489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:23.051443    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf-util\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:04:23.717569 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:23.717537    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4"
Jul 31 22:04:23.717569 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:23.717548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8g9h4" event={"ID":"d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf","Type":"ContainerDied","Data":"b79b6847e7f13201784197f35cf68d8806f12601f0afa38940dd8a95c7367adf"}
Jul 31 22:04:23.717785 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:23.717615    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b79b6847e7f13201784197f35cf68d8806f12601f0afa38940dd8a95c7367adf"
Jul 31 22:04:30.986635 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.986555    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"]
Jul 31 22:04:30.986990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.986873    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerName="pull"
Jul 31 22:04:30.986990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.986885    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerName="pull"
Jul 31 22:04:30.986990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.986894    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerName="util"
Jul 31 22:04:30.986990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.986899    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerName="util"
Jul 31 22:04:30.986990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.986906    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerName="extract"
Jul 31 22:04:30.986990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.986912    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerName="extract"
Jul 31 22:04:30.986990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.986960    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d0b064-47e6-4c5e-86f1-d3c9499ebbdf" containerName="extract"
Jul 31 22:04:30.989071 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.989050    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:30.994408 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.994386    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 22:04:30.994664 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.994647    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wczhl\""
Jul 31 22:04:30.994755 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.994675    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 22:04:30.994755 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.994685    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 22:04:30.994755 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:30.994647    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 22:04:31.011795 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.011759    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"]
Jul 31 22:04:31.122867 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.122829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdde1527-5446-484a-9efc-26377a8c4a89-tmp\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.122867 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.122874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cdde1527-5446-484a-9efc-26377a8c4a89-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.123097 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.122917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cdde1527-5446-484a-9efc-26377a8c4a89-manifests\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.123097 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.122948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlqdx\" (UniqueName: \"kubernetes.io/projected/cdde1527-5446-484a-9efc-26377a8c4a89-kube-api-access-hlqdx\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.123097 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.122966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdde1527-5446-484a-9efc-26377a8c4a89-webhook-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.223743 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.223703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdde1527-5446-484a-9efc-26377a8c4a89-tmp\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.223743 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.223749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cdde1527-5446-484a-9efc-26377a8c4a89-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.223964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.223780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cdde1527-5446-484a-9efc-26377a8c4a89-manifests\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.223964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.223801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlqdx\" (UniqueName: \"kubernetes.io/projected/cdde1527-5446-484a-9efc-26377a8c4a89-kube-api-access-hlqdx\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.223964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.223820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdde1527-5446-484a-9efc-26377a8c4a89-webhook-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.224217 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.224168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cdde1527-5446-484a-9efc-26377a8c4a89-manifests\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.226241 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.226208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdde1527-5446-484a-9efc-26377a8c4a89-tmp\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.226344 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.226294    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cdde1527-5446-484a-9efc-26377a8c4a89-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.226344 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.226322    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdde1527-5446-484a-9efc-26377a8c4a89-webhook-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.234963 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.234941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlqdx\" (UniqueName: \"kubernetes.io/projected/cdde1527-5446-484a-9efc-26377a8c4a89-kube-api-access-hlqdx\") pod \"opendatahub-operator-controller-manager-79bdc6db47-nhxt7\" (UID: \"cdde1527-5446-484a-9efc-26377a8c4a89\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.299076 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.298984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:31.438764 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.438736    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"]
Jul 31 22:04:31.440500 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:04:31.440474    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdde1527_5446_484a_9efc_26377a8c4a89.slice/crio-e3ffcfc60b1c4153f397e830660c987b1db08e9b2c8749beda28214d74e7467a WatchSource:0}: Error finding container e3ffcfc60b1c4153f397e830660c987b1db08e9b2c8749beda28214d74e7467a: Status 404 returned error can't find the container with id e3ffcfc60b1c4153f397e830660c987b1db08e9b2c8749beda28214d74e7467a
Jul 31 22:04:31.756239 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:31.756206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7" event={"ID":"cdde1527-5446-484a-9efc-26377a8c4a89","Type":"ContainerStarted","Data":"e3ffcfc60b1c4153f397e830660c987b1db08e9b2c8749beda28214d74e7467a"}
Jul 31 22:04:34.774000 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:34.773910    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7" event={"ID":"cdde1527-5446-484a-9efc-26377a8c4a89","Type":"ContainerStarted","Data":"e5a068e22e5d768bb964d7a60526b5b971daa30985da79c43d54105456f16314"}
Jul 31 22:04:35.779755 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:35.779715    2577 generic.go:356] "Generic (PLEG): container finished" podID="cdde1527-5446-484a-9efc-26377a8c4a89" containerID="e5a068e22e5d768bb964d7a60526b5b971daa30985da79c43d54105456f16314" exitCode=0
Jul 31 22:04:35.780163 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:35.779805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7" event={"ID":"cdde1527-5446-484a-9efc-26377a8c4a89","Type":"ContainerDied","Data":"e5a068e22e5d768bb964d7a60526b5b971daa30985da79c43d54105456f16314"}
Jul 31 22:04:36.787282 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:36.787243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7" event={"ID":"cdde1527-5446-484a-9efc-26377a8c4a89","Type":"ContainerStarted","Data":"d737f917f78859ba86620cc58cc57fce8a21578543c4eea2fcfcc3fcb7e5ef53"}
Jul 31 22:04:36.787700 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:36.787383    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:36.833051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:36.832999    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7" podStartSLOduration=2.4844014 podStartE2EDuration="6.832982928s" totalImagesPullingTime="3.291273759s" totalInitContainerRuntime="1.057307769s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:36.832123059 +0000 UTC m=+268.785209300" watchObservedRunningTime="2026-07-31 22:04:36.832982928 +0000 UTC m=+268.786069157"
Jul 31 22:04:47.795126 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:47.795092    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-nhxt7"
Jul 31 22:04:51.411906 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.411869    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gtp5r"]
Jul 31 22:04:51.418237 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.418218    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:51.424784 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.424761    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 31 22:04:51.424952 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.424928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-h72dk\""
Jul 31 22:04:51.446739 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.446713    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gtp5r"]
Jul 31 22:04:51.504863 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.504829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d75910-92f9-407a-9560-693a69510cc7-cert\") pod \"odh-model-controller-7998c67dc4-gtp5r\" (UID: \"c2d75910-92f9-407a-9560-693a69510cc7\") " pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:51.505044 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.504864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rlnm\" (UniqueName: \"kubernetes.io/projected/c2d75910-92f9-407a-9560-693a69510cc7-kube-api-access-5rlnm\") pod \"odh-model-controller-7998c67dc4-gtp5r\" (UID: \"c2d75910-92f9-407a-9560-693a69510cc7\") " pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:51.606286 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.606250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d75910-92f9-407a-9560-693a69510cc7-cert\") pod \"odh-model-controller-7998c67dc4-gtp5r\" (UID: \"c2d75910-92f9-407a-9560-693a69510cc7\") " pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:51.606489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.606303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rlnm\" (UniqueName: \"kubernetes.io/projected/c2d75910-92f9-407a-9560-693a69510cc7-kube-api-access-5rlnm\") pod \"odh-model-controller-7998c67dc4-gtp5r\" (UID: \"c2d75910-92f9-407a-9560-693a69510cc7\") " pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:51.606723 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:04:51.606698    2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 31 22:04:51.606938 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:04:51.606914    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d75910-92f9-407a-9560-693a69510cc7-cert podName:c2d75910-92f9-407a-9560-693a69510cc7 nodeName:}" failed. No retries permitted until 2026-07-31 22:04:52.106888643 +0000 UTC m=+284.059974864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c2d75910-92f9-407a-9560-693a69510cc7-cert") pod "odh-model-controller-7998c67dc4-gtp5r" (UID: "c2d75910-92f9-407a-9560-693a69510cc7") : secret "odh-model-controller-webhook-cert" not found
Jul 31 22:04:51.608365 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.608344    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"]
Jul 31 22:04:51.610732 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.610716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.614674 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.614656    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 31 22:04:51.614873 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.614855    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g5ssw\""
Jul 31 22:04:51.615038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.615015    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 31 22:04:51.615199 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.615145    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 22:04:51.615289 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.615257    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 31 22:04:51.619909 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.619887    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 22:04:51.623212 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.623165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rlnm\" (UniqueName: \"kubernetes.io/projected/c2d75910-92f9-407a-9560-693a69510cc7-kube-api-access-5rlnm\") pod \"odh-model-controller-7998c67dc4-gtp5r\" (UID: \"c2d75910-92f9-407a-9560-693a69510cc7\") " pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:51.634452 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.634420    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"]
Jul 31 22:04:51.707273 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.707165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4lbs\" (UniqueName: \"kubernetes.io/projected/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-kube-api-access-p4lbs\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.707450 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.707307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-cert\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.707450 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.707369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-metrics-cert\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.707562 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.707480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-manager-config\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.808792 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.808754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-manager-config\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.808990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.808808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4lbs\" (UniqueName: \"kubernetes.io/projected/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-kube-api-access-p4lbs\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.808990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.808863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-cert\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.808990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.808882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-metrics-cert\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.809507 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.809481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-manager-config\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.811404 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.811380    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-metrics-cert\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.811499 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.811432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-cert\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.822713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.822691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4lbs\" (UniqueName: \"kubernetes.io/projected/0e8f6164-a7bf-47e8-b10b-bf532e47fe0b-kube-api-access-p4lbs\") pod \"lws-controller-manager-5587bd887b-6q245\" (UID: \"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:51.920749 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:51.920714    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:52.078250 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:52.078213    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"]
Jul 31 22:04:52.083968 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:04:52.083933    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8f6164_a7bf_47e8_b10b_bf532e47fe0b.slice/crio-e05d9039a1bb7eb10f50147c4dfdc665e15a5e577fe4d2f566f308c3e831339c WatchSource:0}: Error finding container e05d9039a1bb7eb10f50147c4dfdc665e15a5e577fe4d2f566f308c3e831339c: Status 404 returned error can't find the container with id e05d9039a1bb7eb10f50147c4dfdc665e15a5e577fe4d2f566f308c3e831339c
Jul 31 22:04:52.111373 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:52.111330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d75910-92f9-407a-9560-693a69510cc7-cert\") pod \"odh-model-controller-7998c67dc4-gtp5r\" (UID: \"c2d75910-92f9-407a-9560-693a69510cc7\") " pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:52.113679 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:52.113656    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2d75910-92f9-407a-9560-693a69510cc7-cert\") pod \"odh-model-controller-7998c67dc4-gtp5r\" (UID: \"c2d75910-92f9-407a-9560-693a69510cc7\") " pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:52.328395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:52.328301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:52.494337 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:52.494309    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gtp5r"]
Jul 31 22:04:52.496950 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:04:52.496904    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d75910_92f9_407a_9560_693a69510cc7.slice/crio-56e31f421e72851a1d1a9300447b23df3c814e46f6f9997dae03893dfb11444e WatchSource:0}: Error finding container 56e31f421e72851a1d1a9300447b23df3c814e46f6f9997dae03893dfb11444e: Status 404 returned error can't find the container with id 56e31f421e72851a1d1a9300447b23df3c814e46f6f9997dae03893dfb11444e
Jul 31 22:04:52.866151 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:52.866067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r" event={"ID":"c2d75910-92f9-407a-9560-693a69510cc7","Type":"ContainerStarted","Data":"56e31f421e72851a1d1a9300447b23df3c814e46f6f9997dae03893dfb11444e"}
Jul 31 22:04:52.867645 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:52.867589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245" event={"ID":"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b","Type":"ContainerStarted","Data":"e05d9039a1bb7eb10f50147c4dfdc665e15a5e577fe4d2f566f308c3e831339c"}
Jul 31 22:04:55.890087 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:55.890029    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r" event={"ID":"c2d75910-92f9-407a-9560-693a69510cc7","Type":"ContainerStarted","Data":"ba89024265f9db2c450c98d200836f45b120a6b2341e1a22949ef0b404b717ed"}
Jul 31 22:04:55.890578 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:55.890225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:04:55.891897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:55.891871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245" event={"ID":"0e8f6164-a7bf-47e8-b10b-bf532e47fe0b","Type":"ContainerStarted","Data":"ba9f91c4c183c6e6d5e96a1b04b54fdfef4bdffb42e328116b95526382b30b47"}
Jul 31 22:04:55.891995 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:55.891921    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:04:55.910317 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:55.910263    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r" podStartSLOduration=2.214173449 podStartE2EDuration="4.910246204s" totalImagesPullingTime="2.696072755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:55.908655835 +0000 UTC m=+287.861742063" watchObservedRunningTime="2026-07-31 22:04:55.910246204 +0000 UTC m=+287.863332433"
Jul 31 22:04:55.926814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:04:55.926764    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245" podStartSLOduration=3.107817247 podStartE2EDuration="4.92674887s" totalImagesPullingTime="1.818931623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:55.926122469 +0000 UTC m=+287.879208701" watchObservedRunningTime="2026-07-31 22:04:55.92674887 +0000 UTC m=+287.879835099"
Jul 31 22:05:05.241984 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.241945    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"]
Jul 31 22:05:05.249998 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.249977    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.274062 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.274027    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 31 22:05:05.274062 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.274028    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 31 22:05:05.274321 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.274104    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 22:05:05.274321 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.274039    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 22:05:05.274321 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.274038    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 31 22:05:05.274321 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.274146    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 22:05:05.274924 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.274877    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pdc4w\""
Jul 31 22:05:05.283072 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.283039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"]
Jul 31 22:05:05.331238 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.331198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.331431 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.331263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.331431 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.331304    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.331431 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.331357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.331598 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.331424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.331598 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.331508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.331598 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.331542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv2m6\" (UniqueName: \"kubernetes.io/projected/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-kube-api-access-cv2m6\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.432366 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.432318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.432540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.432389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.432540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.432414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv2m6\" (UniqueName: \"kubernetes.io/projected/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-kube-api-access-cv2m6\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.432540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.432473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.432540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.432498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.432776 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.432539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.432776 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.432583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.433229 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.433200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.434707 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.434677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.434858 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.434840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.434917 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.434845    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.434917 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.434867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.441510 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.441486    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv2m6\" (UniqueName: \"kubernetes.io/projected/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-kube-api-access-cv2m6\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.443480 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.443459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02c807ac-6653-4e86-9f9c-2409c5b8ed9e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-sj95h\" (UID: \"02c807ac-6653-4e86-9f9c-2409c5b8ed9e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.558638 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.558560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:05.704063 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.704027    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"]
Jul 31 22:05:05.707529 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:05:05.707498    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c807ac_6653_4e86_9f9c_2409c5b8ed9e.slice/crio-cfecfafc4f061b6e4ff15abc52c36c8235122598e20c68cc74756c9e4ffc229a WatchSource:0}: Error finding container cfecfafc4f061b6e4ff15abc52c36c8235122598e20c68cc74756c9e4ffc229a: Status 404 returned error can't find the container with id cfecfafc4f061b6e4ff15abc52c36c8235122598e20c68cc74756c9e4ffc229a
Jul 31 22:05:05.940163 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:05.940127    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h" event={"ID":"02c807ac-6653-4e86-9f9c-2409c5b8ed9e","Type":"ContainerStarted","Data":"cfecfafc4f061b6e4ff15abc52c36c8235122598e20c68cc74756c9e4ffc229a"}
Jul 31 22:05:06.899886 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:06.899852    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-6q245"
Jul 31 22:05:06.947320 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:06.946435    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gtp5r"
Jul 31 22:05:08.397028 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:08.396976    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 31 22:05:08.397401 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:08.397063    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 31 22:05:08.437396 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:08.437368    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 22:05:08.964059 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:08.964021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h" event={"ID":"02c807ac-6653-4e86-9f9c-2409c5b8ed9e","Type":"ContainerStarted","Data":"00aa164a2b000f8c290d1575edce0c80ff8fd01f2ee6c6a9d450ee81f1e9ffc5"}
Jul 31 22:05:08.966128 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:08.964085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:08.987952 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:08.987891    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h" podStartSLOduration=1.301140335 podStartE2EDuration="3.987870879s" totalImagesPullingTime="2.686730544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:05:08.986288185 +0000 UTC m=+300.939374428" watchObservedRunningTime="2026-07-31 22:05:08.987870879 +0000 UTC m=+300.940957110"
Jul 31 22:05:09.971657 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:09.971626    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-sj95h"
Jul 31 22:05:56.082906 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.082873    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"]
Jul 31 22:05:56.093127 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.093099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.094220 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.094190    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"]
Jul 31 22:05:56.095942 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.095917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hwmps\""
Jul 31 22:05:56.096056 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.095919    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 31 22:05:56.096688 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.096668    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 31 22:05:56.174886 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.174851    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"]
Jul 31 22:05:56.178807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.178788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.185373 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.185338    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.185537 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.185403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2kwv\" (UniqueName: \"kubernetes.io/projected/82274fca-ea67-479b-bb09-f714571dd123-kube-api-access-v2kwv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.185537 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.185464    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.188558 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.188455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"]
Jul 31 22:05:56.272193 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.272153    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"]
Jul 31 22:05:56.276029 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.276011    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.284239 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.284200    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"]
Jul 31 22:05:56.286567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.286542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.286694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.286638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.286694 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.286686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.286805 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.286722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmsmt\" (UniqueName: \"kubernetes.io/projected/4510da1c-487f-41a4-8b10-0195ce4323d4-kube-api-access-dmsmt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.286805 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.286751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kwv\" (UniqueName: \"kubernetes.io/projected/82274fca-ea67-479b-bb09-f714571dd123-kube-api-access-v2kwv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.286805 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.286767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.286989 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.286967    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.287027 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.286998    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.297965 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.297934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2kwv\" (UniqueName: \"kubernetes.io/projected/82274fca-ea67-479b-bb09-f714571dd123-kube-api-access-v2kwv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.373337 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.373247    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"]
Jul 31 22:05:56.377226 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.377209    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.385713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.385685    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"]
Jul 31 22:05:56.387352 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.387322    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkrkn\" (UniqueName: \"kubernetes.io/projected/62b66932-30e6-4ec4-b71b-fac7971c2e18-kube-api-access-hkrkn\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.387449 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.387371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmsmt\" (UniqueName: \"kubernetes.io/projected/4510da1c-487f-41a4-8b10-0195ce4323d4-kube-api-access-dmsmt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.387449 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.387412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.387449 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.387441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.387605 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.387508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.387654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.387623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.387827 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.387806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.387938 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.387923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.398768 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.398743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmsmt\" (UniqueName: \"kubernetes.io/projected/4510da1c-487f-41a4-8b10-0195ce4323d4-kube-api-access-dmsmt\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.404618 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.404588    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:05:56.488783 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.488730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.488943 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.488795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkrkn\" (UniqueName: \"kubernetes.io/projected/62b66932-30e6-4ec4-b71b-fac7971c2e18-kube-api-access-hkrkn\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.488943 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.488844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.488943 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.488908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.489136 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.488969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.489136 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.489033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r862n\" (UniqueName: \"kubernetes.io/projected/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-kube-api-access-r862n\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.489818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.489484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.489818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.489499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.489818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.489612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:05:56.499672 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.499641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkrkn\" (UniqueName: \"kubernetes.io/projected/62b66932-30e6-4ec4-b71b-fac7971c2e18-kube-api-access-hkrkn\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.544812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.544786    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"]
Jul 31 22:05:56.547141 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:05:56.547100    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82274fca_ea67_479b_bb09_f714571dd123.slice/crio-b851db745f268326877f918c6dc69c7d79e7dd9d158bfceb4ce95b9792b2bcba WatchSource:0}: Error finding container b851db745f268326877f918c6dc69c7d79e7dd9d158bfceb4ce95b9792b2bcba: Status 404 returned error can't find the container with id b851db745f268326877f918c6dc69c7d79e7dd9d158bfceb4ce95b9792b2bcba
Jul 31 22:05:56.586200 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.586152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:05:56.589713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.589641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r862n\" (UniqueName: \"kubernetes.io/projected/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-kube-api-access-r862n\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.589713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.589705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.589913 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.589732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.590115 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.590091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.590115 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.590107    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.599772 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.599709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r862n\" (UniqueName: \"kubernetes.io/projected/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-kube-api-access-r862n\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.653886 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.653058    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"]
Jul 31 22:05:56.657748 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:05:56.656854    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4510da1c_487f_41a4_8b10_0195ce4323d4.slice/crio-5c56324c20c11cbc280946adfcdc438978ad7dc95840ec0e3e2334af474b5861 WatchSource:0}: Error finding container 5c56324c20c11cbc280946adfcdc438978ad7dc95840ec0e3e2334af474b5861: Status 404 returned error can't find the container with id 5c56324c20c11cbc280946adfcdc438978ad7dc95840ec0e3e2334af474b5861
Jul 31 22:05:56.688138 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.688102    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:05:56.756990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.756873    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"]
Jul 31 22:05:56.851403 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:56.851363    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"]
Jul 31 22:05:56.872833 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:05:56.872793    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f9b2a8_6788_42ca_8540_f8c8f53c1617.slice/crio-b1daa9a07bdc0f1a621847752ae756424d3479a51823741644ea0a7e9417284e WatchSource:0}: Error finding container b1daa9a07bdc0f1a621847752ae756424d3479a51823741644ea0a7e9417284e: Status 404 returned error can't find the container with id b1daa9a07bdc0f1a621847752ae756424d3479a51823741644ea0a7e9417284e
Jul 31 22:05:57.197317 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.197216    2577 generic.go:356] "Generic (PLEG): container finished" podID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerID="aa23568b44058f44dbc9734cf0febfed9b9f5fe53dbe95f8101abb617a3b2fe0" exitCode=0
Jul 31 22:05:57.197317 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.197281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl" event={"ID":"62b66932-30e6-4ec4-b71b-fac7971c2e18","Type":"ContainerDied","Data":"aa23568b44058f44dbc9734cf0febfed9b9f5fe53dbe95f8101abb617a3b2fe0"}
Jul 31 22:05:57.197814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.197339    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl" event={"ID":"62b66932-30e6-4ec4-b71b-fac7971c2e18","Type":"ContainerStarted","Data":"b76dd70ef91269e042f0462262c483ca1797bb620f0f9f10e456c69f4e778d5c"}
Jul 31 22:05:57.198496 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.198479    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:05:57.198750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.198729    2577 generic.go:356] "Generic (PLEG): container finished" podID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerID="f1ae06472f205c90dd3fc081af43e8671fbb68fc4e3f29be1a668e4d98a15818" exitCode=0
Jul 31 22:05:57.198843 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.198786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj" event={"ID":"4510da1c-487f-41a4-8b10-0195ce4323d4","Type":"ContainerDied","Data":"f1ae06472f205c90dd3fc081af43e8671fbb68fc4e3f29be1a668e4d98a15818"}
Jul 31 22:05:57.198843 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.198827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj" event={"ID":"4510da1c-487f-41a4-8b10-0195ce4323d4","Type":"ContainerStarted","Data":"5c56324c20c11cbc280946adfcdc438978ad7dc95840ec0e3e2334af474b5861"}
Jul 31 22:05:57.200342 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.200322    2577 generic.go:356] "Generic (PLEG): container finished" podID="82274fca-ea67-479b-bb09-f714571dd123" containerID="90b1930cbeb0c68dc79c3b142aff84432ed0443bf381decb0960b6ac31ee1206" exitCode=0
Jul 31 22:05:57.200415 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.200402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485" event={"ID":"82274fca-ea67-479b-bb09-f714571dd123","Type":"ContainerDied","Data":"90b1930cbeb0c68dc79c3b142aff84432ed0443bf381decb0960b6ac31ee1206"}
Jul 31 22:05:57.200461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.200433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485" event={"ID":"82274fca-ea67-479b-bb09-f714571dd123","Type":"ContainerStarted","Data":"b851db745f268326877f918c6dc69c7d79e7dd9d158bfceb4ce95b9792b2bcba"}
Jul 31 22:05:57.201989 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.201967    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerID="d766316985e12d7b7a0f189865bc93c85617a6bc30edf1e158232e39b9eb63c1" exitCode=0
Jul 31 22:05:57.202087 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.202004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm" event={"ID":"d8f9b2a8-6788-42ca-8540-f8c8f53c1617","Type":"ContainerDied","Data":"d766316985e12d7b7a0f189865bc93c85617a6bc30edf1e158232e39b9eb63c1"}
Jul 31 22:05:57.202087 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:57.202031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm" event={"ID":"d8f9b2a8-6788-42ca-8540-f8c8f53c1617","Type":"ContainerStarted","Data":"b1daa9a07bdc0f1a621847752ae756424d3479a51823741644ea0a7e9417284e"}
Jul 31 22:05:58.209639 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:58.209610    2577 generic.go:356] "Generic (PLEG): container finished" podID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerID="a17656b406453d9d0b1efa2ce46973903c02e7fbc297315ff74edbc6cc9e6834" exitCode=0
Jul 31 22:05:58.209947 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:58.209689    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj" event={"ID":"4510da1c-487f-41a4-8b10-0195ce4323d4","Type":"ContainerDied","Data":"a17656b406453d9d0b1efa2ce46973903c02e7fbc297315ff74edbc6cc9e6834"}
Jul 31 22:05:59.216337 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:59.216300    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerID="fbe7b5e487a5b9ef304544ac86e38db6a82c53ccaa309f56629b36921362a6be" exitCode=0
Jul 31 22:05:59.216769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:59.216393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm" event={"ID":"d8f9b2a8-6788-42ca-8540-f8c8f53c1617","Type":"ContainerDied","Data":"fbe7b5e487a5b9ef304544ac86e38db6a82c53ccaa309f56629b36921362a6be"}
Jul 31 22:05:59.218320 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:59.218298    2577 generic.go:356] "Generic (PLEG): container finished" podID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerID="1eeb92c255ba80f84eb4aa0830bfa20ab96d8375d1c99375d3e1c31d488b2197" exitCode=0
Jul 31 22:05:59.218412 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:59.218372    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl" event={"ID":"62b66932-30e6-4ec4-b71b-fac7971c2e18","Type":"ContainerDied","Data":"1eeb92c255ba80f84eb4aa0830bfa20ab96d8375d1c99375d3e1c31d488b2197"}
Jul 31 22:05:59.220529 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:59.220506    2577 generic.go:356] "Generic (PLEG): container finished" podID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerID="2e6a09e1f51bae921b37f7431f49160c71ac49eba7f347aab3894efb098a4d67" exitCode=0
Jul 31 22:05:59.220630 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:59.220571    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj" event={"ID":"4510da1c-487f-41a4-8b10-0195ce4323d4","Type":"ContainerDied","Data":"2e6a09e1f51bae921b37f7431f49160c71ac49eba7f347aab3894efb098a4d67"}
Jul 31 22:05:59.222330 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:59.222309    2577 generic.go:356] "Generic (PLEG): container finished" podID="82274fca-ea67-479b-bb09-f714571dd123" containerID="22bb165df22b120d99d2247b2031114f9b278f32da57cec4883d84a0217aeb0a" exitCode=0
Jul 31 22:05:59.222416 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:05:59.222341    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485" event={"ID":"82274fca-ea67-479b-bb09-f714571dd123","Type":"ContainerDied","Data":"22bb165df22b120d99d2247b2031114f9b278f32da57cec4883d84a0217aeb0a"}
Jul 31 22:05:59.394225 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:05:59.394192    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f9b2a8_6788_42ca_8540_f8c8f53c1617.slice/crio-a9d23b93482ead64007f92a31d44ec25c39d1f0f8ad0998c4e438ed77f2a1617.scope\": RecentStats: unable to find data in memory cache]"
Jul 31 22:06:00.232190 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.232089    2577 generic.go:356] "Generic (PLEG): container finished" podID="82274fca-ea67-479b-bb09-f714571dd123" containerID="e1b8d90b15ef47ff6986b6439b49b21930d25a441dbdc09b95f84eece81a9882" exitCode=0
Jul 31 22:06:00.232590 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.232188    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485" event={"ID":"82274fca-ea67-479b-bb09-f714571dd123","Type":"ContainerDied","Data":"e1b8d90b15ef47ff6986b6439b49b21930d25a441dbdc09b95f84eece81a9882"}
Jul 31 22:06:00.234185 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.234155    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerID="a9d23b93482ead64007f92a31d44ec25c39d1f0f8ad0998c4e438ed77f2a1617" exitCode=0
Jul 31 22:06:00.234292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.234202    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm" event={"ID":"d8f9b2a8-6788-42ca-8540-f8c8f53c1617","Type":"ContainerDied","Data":"a9d23b93482ead64007f92a31d44ec25c39d1f0f8ad0998c4e438ed77f2a1617"}
Jul 31 22:06:00.236466 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.236445    2577 generic.go:356] "Generic (PLEG): container finished" podID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerID="7a20a4f2891d2c48a162897799128d38ac8f6cb528d1f3d2cfb59f68783bba9f" exitCode=0
Jul 31 22:06:00.236596 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.236517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl" event={"ID":"62b66932-30e6-4ec4-b71b-fac7971c2e18","Type":"ContainerDied","Data":"7a20a4f2891d2c48a162897799128d38ac8f6cb528d1f3d2cfb59f68783bba9f"}
Jul 31 22:06:00.366418 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.366388    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:06:00.432279 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.432241    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-bundle\") pod \"4510da1c-487f-41a4-8b10-0195ce4323d4\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") "
Jul 31 22:06:00.432455 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.432318    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmsmt\" (UniqueName: \"kubernetes.io/projected/4510da1c-487f-41a4-8b10-0195ce4323d4-kube-api-access-dmsmt\") pod \"4510da1c-487f-41a4-8b10-0195ce4323d4\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") "
Jul 31 22:06:00.432455 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.432349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-util\") pod \"4510da1c-487f-41a4-8b10-0195ce4323d4\" (UID: \"4510da1c-487f-41a4-8b10-0195ce4323d4\") "
Jul 31 22:06:00.432861 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.432836    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-bundle" (OuterVolumeSpecName: "bundle") pod "4510da1c-487f-41a4-8b10-0195ce4323d4" (UID: "4510da1c-487f-41a4-8b10-0195ce4323d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:00.434491 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.434465    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4510da1c-487f-41a4-8b10-0195ce4323d4-kube-api-access-dmsmt" (OuterVolumeSpecName: "kube-api-access-dmsmt") pod "4510da1c-487f-41a4-8b10-0195ce4323d4" (UID: "4510da1c-487f-41a4-8b10-0195ce4323d4"). InnerVolumeSpecName "kube-api-access-dmsmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:06:00.437793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.437765    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-util" (OuterVolumeSpecName: "util") pod "4510da1c-487f-41a4-8b10-0195ce4323d4" (UID: "4510da1c-487f-41a4-8b10-0195ce4323d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:00.532970 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.532880    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:00.532970 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.532903    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmsmt\" (UniqueName: \"kubernetes.io/projected/4510da1c-487f-41a4-8b10-0195ce4323d4-kube-api-access-dmsmt\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:00.532970 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:00.532913    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4510da1c-487f-41a4-8b10-0195ce4323d4-util\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.243312 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.243280    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj"
Jul 31 22:06:01.243312 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.243297    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbzq8jj" event={"ID":"4510da1c-487f-41a4-8b10-0195ce4323d4","Type":"ContainerDied","Data":"5c56324c20c11cbc280946adfcdc438978ad7dc95840ec0e3e2334af474b5861"}
Jul 31 22:06:01.243772 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.243352    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c56324c20c11cbc280946adfcdc438978ad7dc95840ec0e3e2334af474b5861"
Jul 31 22:06:01.381915 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.381887    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:06:01.430812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.430786    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:06:01.433636 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.433613    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:06:01.440781 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.440758    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-bundle\") pod \"62b66932-30e6-4ec4-b71b-fac7971c2e18\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") "
Jul 31 22:06:01.440858 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.440803    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkrkn\" (UniqueName: \"kubernetes.io/projected/62b66932-30e6-4ec4-b71b-fac7971c2e18-kube-api-access-hkrkn\") pod \"62b66932-30e6-4ec4-b71b-fac7971c2e18\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") "
Jul 31 22:06:01.440926 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.440909    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-util\") pod \"62b66932-30e6-4ec4-b71b-fac7971c2e18\" (UID: \"62b66932-30e6-4ec4-b71b-fac7971c2e18\") "
Jul 31 22:06:01.441485 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.441450    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-bundle" (OuterVolumeSpecName: "bundle") pod "62b66932-30e6-4ec4-b71b-fac7971c2e18" (UID: "62b66932-30e6-4ec4-b71b-fac7971c2e18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:01.442975 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.442951    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62b66932-30e6-4ec4-b71b-fac7971c2e18-kube-api-access-hkrkn" (OuterVolumeSpecName: "kube-api-access-hkrkn") pod "62b66932-30e6-4ec4-b71b-fac7971c2e18" (UID: "62b66932-30e6-4ec4-b71b-fac7971c2e18"). InnerVolumeSpecName "kube-api-access-hkrkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:06:01.446049 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.446026    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-util" (OuterVolumeSpecName: "util") pod "62b66932-30e6-4ec4-b71b-fac7971c2e18" (UID: "62b66932-30e6-4ec4-b71b-fac7971c2e18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:01.542078 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.541985    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2kwv\" (UniqueName: \"kubernetes.io/projected/82274fca-ea67-479b-bb09-f714571dd123-kube-api-access-v2kwv\") pod \"82274fca-ea67-479b-bb09-f714571dd123\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") "
Jul 31 22:06:01.542078 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542045    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-bundle\") pod \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") "
Jul 31 22:06:01.542342 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542088    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-util\") pod \"82274fca-ea67-479b-bb09-f714571dd123\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") "
Jul 31 22:06:01.542342 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542114    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-bundle\") pod \"82274fca-ea67-479b-bb09-f714571dd123\" (UID: \"82274fca-ea67-479b-bb09-f714571dd123\") "
Jul 31 22:06:01.542342 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542150    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-util\") pod \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") "
Jul 31 22:06:01.542342 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r862n\" (UniqueName: \"kubernetes.io/projected/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-kube-api-access-r862n\") pod \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\" (UID: \"d8f9b2a8-6788-42ca-8540-f8c8f53c1617\") "
Jul 31 22:06:01.542601 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542419    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-util\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.542601 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542439    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62b66932-30e6-4ec4-b71b-fac7971c2e18-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.542601 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542453    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkrkn\" (UniqueName: \"kubernetes.io/projected/62b66932-30e6-4ec4-b71b-fac7971c2e18-kube-api-access-hkrkn\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.542764 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542736    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-bundle" (OuterVolumeSpecName: "bundle") pod "d8f9b2a8-6788-42ca-8540-f8c8f53c1617" (UID: "d8f9b2a8-6788-42ca-8540-f8c8f53c1617"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:01.542888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.542862    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-bundle" (OuterVolumeSpecName: "bundle") pod "82274fca-ea67-479b-bb09-f714571dd123" (UID: "82274fca-ea67-479b-bb09-f714571dd123"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:01.544376 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.544351    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82274fca-ea67-479b-bb09-f714571dd123-kube-api-access-v2kwv" (OuterVolumeSpecName: "kube-api-access-v2kwv") pod "82274fca-ea67-479b-bb09-f714571dd123" (UID: "82274fca-ea67-479b-bb09-f714571dd123"). InnerVolumeSpecName "kube-api-access-v2kwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:06:01.544473 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.544434    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-kube-api-access-r862n" (OuterVolumeSpecName: "kube-api-access-r862n") pod "d8f9b2a8-6788-42ca-8540-f8c8f53c1617" (UID: "d8f9b2a8-6788-42ca-8540-f8c8f53c1617"). InnerVolumeSpecName "kube-api-access-r862n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:06:01.548061 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.548035    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-util" (OuterVolumeSpecName: "util") pod "d8f9b2a8-6788-42ca-8540-f8c8f53c1617" (UID: "d8f9b2a8-6788-42ca-8540-f8c8f53c1617"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:01.548297 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.548278    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-util" (OuterVolumeSpecName: "util") pod "82274fca-ea67-479b-bb09-f714571dd123" (UID: "82274fca-ea67-479b-bb09-f714571dd123"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:06:01.642918 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.642875    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-util\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.642918 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.642911    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r862n\" (UniqueName: \"kubernetes.io/projected/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-kube-api-access-r862n\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.642918 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.642923    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2kwv\" (UniqueName: \"kubernetes.io/projected/82274fca-ea67-479b-bb09-f714571dd123-kube-api-access-v2kwv\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.643253 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.642933    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8f9b2a8-6788-42ca-8540-f8c8f53c1617-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.643253 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.642946    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-util\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:01.643253 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:01.642957    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82274fca-ea67-479b-bb09-f714571dd123-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:02.250797 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.250758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm" event={"ID":"d8f9b2a8-6788-42ca-8540-f8c8f53c1617","Type":"ContainerDied","Data":"b1daa9a07bdc0f1a621847752ae756424d3479a51823741644ea0a7e9417284e"}
Jul 31 22:06:02.250797 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.250778    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cl8mvm"
Jul 31 22:06:02.251299 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.250816    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1daa9a07bdc0f1a621847752ae756424d3479a51823741644ea0a7e9417284e"
Jul 31 22:06:02.252862 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.252842    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl"
Jul 31 22:06:02.252999 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.252866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053922nl" event={"ID":"62b66932-30e6-4ec4-b71b-fac7971c2e18","Type":"ContainerDied","Data":"b76dd70ef91269e042f0462262c483ca1797bb620f0f9f10e456c69f4e778d5c"}
Jul 31 22:06:02.252999 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.252903    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b76dd70ef91269e042f0462262c483ca1797bb620f0f9f10e456c69f4e778d5c"
Jul 31 22:06:02.254737 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.254714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485" event={"ID":"82274fca-ea67-479b-bb09-f714571dd123","Type":"ContainerDied","Data":"b851db745f268326877f918c6dc69c7d79e7dd9d158bfceb4ce95b9792b2bcba"}
Jul 31 22:06:02.254862 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.254750    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b851db745f268326877f918c6dc69c7d79e7dd9d158bfceb4ce95b9792b2bcba"
Jul 31 22:06:02.254862 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:02.254770    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0sw485"
Jul 31 22:06:26.909664 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:26.909629    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5479fff965-vljng"]
Jul 31 22:06:51.929225 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:51.929169    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5479fff965-vljng" podUID="14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" containerName="console" containerID="cri-o://860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c" gracePeriod=15
Jul 31 22:06:52.176918 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.176892    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:06:52.294245 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294130    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-service-ca\") pod \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") "
Jul 31 22:06:52.294245 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294213    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-serving-cert\") pod \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") "
Jul 31 22:06:52.294245 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294247    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-oauth-config\") pod \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") "
Jul 31 22:06:52.294519 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294288    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-config\") pod \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") "
Jul 31 22:06:52.294519 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294313    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfbb6\" (UniqueName: \"kubernetes.io/projected/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-kube-api-access-tfbb6\") pod \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") "
Jul 31 22:06:52.294519 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294346    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-oauth-serving-cert\") pod \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") "
Jul 31 22:06:52.294519 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294391    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-trusted-ca-bundle\") pod \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\" (UID: \"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4\") "
Jul 31 22:06:52.294719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-service-ca" (OuterVolumeSpecName: "service-ca") pod "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" (UID: "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:06:52.294848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294814    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-config" (OuterVolumeSpecName: "console-config") pod "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" (UID: "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:06:52.294995 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294811    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" (UID: "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:06:52.294995 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.294952    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" (UID: "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:06:52.296510 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.296489    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" (UID: "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:06:52.296595 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.296543    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" (UID: "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:06:52.296639 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.296602    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-kube-api-access-tfbb6" (OuterVolumeSpecName: "kube-api-access-tfbb6") pod "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" (UID: "14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4"). InnerVolumeSpecName "kube-api-access-tfbb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:06:52.395266 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.395228    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:52.395266 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.395259    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-serving-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:52.395477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.395291    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-oauth-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:52.395477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.395307    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-console-config\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:52.395477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.395320    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfbb6\" (UniqueName: \"kubernetes.io/projected/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-kube-api-access-tfbb6\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:52.395477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.395328    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-oauth-serving-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:52.395477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.395337    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4-trusted-ca-bundle\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:06:52.514524 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.514489    2577 generic.go:356] "Generic (PLEG): container finished" podID="14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" containerID="860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c" exitCode=0
Jul 31 22:06:52.514692 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.514536    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5479fff965-vljng"
Jul 31 22:06:52.514692 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.514538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5479fff965-vljng" event={"ID":"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4","Type":"ContainerDied","Data":"860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c"}
Jul 31 22:06:52.514692 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.514663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5479fff965-vljng" event={"ID":"14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4","Type":"ContainerDied","Data":"a56b5c947ac8a5f953ef3e18837fa0cca03f812dbd7144a0d29a44570e9f10eb"}
Jul 31 22:06:52.514692 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.514690    2577 scope.go:117] "RemoveContainer" containerID="860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c"
Jul 31 22:06:52.524317 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.524301    2577 scope.go:117] "RemoveContainer" containerID="860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c"
Jul 31 22:06:52.524577 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:06:52.524562    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c\": container with ID starting with 860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c not found: ID does not exist" containerID="860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c"
Jul 31 22:06:52.524618 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.524586    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c"} err="failed to get container status \"860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c\": rpc error: code = NotFound desc = could not find container \"860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c\": container with ID starting with 860b70a8c520037e84f130c64ffdfd084165909f884c33903682b31d94f2e82c not found: ID does not exist"
Jul 31 22:06:52.537052 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.537023    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5479fff965-vljng"]
Jul 31 22:06:52.546302 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:52.546233    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5479fff965-vljng"]
Jul 31 22:06:54.532140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:06:54.532101    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" path="/var/lib/kubelet/pods/14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4/volumes"
Jul 31 22:07:01.126337 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126296    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"]
Jul 31 22:07:01.126852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126775    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82274fca-ea67-479b-bb09-f714571dd123" containerName="extract"
Jul 31 22:07:01.126852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126796    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82274fca-ea67-479b-bb09-f714571dd123" containerName="extract"
Jul 31 22:07:01.126852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126815    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" containerName="console"
Jul 31 22:07:01.126852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126826    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" containerName="console"
Jul 31 22:07:01.126852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126845    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerName="util"
Jul 31 22:07:01.126852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126853    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerName="util"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126862    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126870    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126888    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerName="util"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126897    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerName="util"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126905    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerName="pull"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126913    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerName="pull"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126928    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerName="pull"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126937    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerName="pull"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126945    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126953    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126963    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82274fca-ea67-479b-bb09-f714571dd123" containerName="util"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126970    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82274fca-ea67-479b-bb09-f714571dd123" containerName="util"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126979    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerName="util"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.126987    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerName="util"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127001    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82274fca-ea67-479b-bb09-f714571dd123" containerName="pull"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127009    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82274fca-ea67-479b-bb09-f714571dd123" containerName="pull"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127019    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerName="pull"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127027    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerName="pull"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127038    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127046    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127123    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="82274fca-ea67-479b-bb09-f714571dd123" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127136    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="62b66932-30e6-4ec4-b71b-fac7971c2e18" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127146    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="14bd67f9-a0db-4dd2-8e25-7f195b4ef3f4" containerName="console"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127157    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4510da1c-487f-41a4-8b10-0195ce4323d4" containerName="extract"
Jul 31 22:07:01.127164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.127164    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8f9b2a8-6788-42ca-8540-f8c8f53c1617" containerName="extract"
Jul 31 22:07:01.135813 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.133300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:01.136769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.136304    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8wdfd\""
Jul 31 22:07:01.136769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.136395    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 22:07:01.136769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.136609    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 31 22:07:01.137424 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.137233    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 22:07:01.141495 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.141472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"]
Jul 31 22:07:01.209378 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.209343    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"]
Jul 31 22:07:01.274641 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.274598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d13601-9b27-489a-8fa9-a0c669f75a4b-config-file\") pod \"limitador-limitador-859c4d96d6-wd9tw\" (UID: \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:01.274825 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.274678    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpxk\" (UniqueName: \"kubernetes.io/projected/d6d13601-9b27-489a-8fa9-a0c669f75a4b-kube-api-access-sxpxk\") pod \"limitador-limitador-859c4d96d6-wd9tw\" (UID: \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:01.375513 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.375480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d13601-9b27-489a-8fa9-a0c669f75a4b-config-file\") pod \"limitador-limitador-859c4d96d6-wd9tw\" (UID: \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:01.375685 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.375528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpxk\" (UniqueName: \"kubernetes.io/projected/d6d13601-9b27-489a-8fa9-a0c669f75a4b-kube-api-access-sxpxk\") pod \"limitador-limitador-859c4d96d6-wd9tw\" (UID: \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:01.376101 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.376081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d13601-9b27-489a-8fa9-a0c669f75a4b-config-file\") pod \"limitador-limitador-859c4d96d6-wd9tw\" (UID: \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:01.384306 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.384245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpxk\" (UniqueName: \"kubernetes.io/projected/d6d13601-9b27-489a-8fa9-a0c669f75a4b-kube-api-access-sxpxk\") pod \"limitador-limitador-859c4d96d6-wd9tw\" (UID: \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:01.447273 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.447232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:01.583040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:01.583012    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"]
Jul 31 22:07:01.585689 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:07:01.585664    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d13601_9b27_489a_8fa9_a0c669f75a4b.slice/crio-42369999f5c761ebacb4bc11a0d6bf865e825cff965f4a02e5440d4be0674eb8 WatchSource:0}: Error finding container 42369999f5c761ebacb4bc11a0d6bf865e825cff965f4a02e5440d4be0674eb8: Status 404 returned error can't find the container with id 42369999f5c761ebacb4bc11a0d6bf865e825cff965f4a02e5440d4be0674eb8
Jul 31 22:07:02.568228 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:02.568169    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw" event={"ID":"d6d13601-9b27-489a-8fa9-a0c669f75a4b","Type":"ContainerStarted","Data":"42369999f5c761ebacb4bc11a0d6bf865e825cff965f4a02e5440d4be0674eb8"}
Jul 31 22:07:04.580629 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:04.580595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw" event={"ID":"d6d13601-9b27-489a-8fa9-a0c669f75a4b","Type":"ContainerStarted","Data":"27ae0053632a7f8113b665c4b253929e82367a1cad54523746ff01c51854a1d1"}
Jul 31 22:07:04.581027 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:04.580693    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:04.599189 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:04.599134    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw" podStartSLOduration=1.176069475 podStartE2EDuration="3.599118252s" totalImagesPullingTime="2.423048777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:04.597424707 +0000 UTC m=+416.550510937" watchObservedRunningTime="2026-07-31 22:07:04.599118252 +0000 UTC m=+416.552204511"
Jul 31 22:07:15.131708 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:15.131667    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"]
Jul 31 22:07:15.132103 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:15.131870    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw" podUID="d6d13601-9b27-489a-8fa9-a0c669f75a4b" containerName="limitador" containerID="cri-o://27ae0053632a7f8113b665c4b253929e82367a1cad54523746ff01c51854a1d1" gracePeriod=30
Jul 31 22:07:15.132709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:15.132566    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:15.643990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:15.643957    2577 generic.go:356] "Generic (PLEG): container finished" podID="d6d13601-9b27-489a-8fa9-a0c669f75a4b" containerID="27ae0053632a7f8113b665c4b253929e82367a1cad54523746ff01c51854a1d1" exitCode=0
Jul 31 22:07:15.644156 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:15.644036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw" event={"ID":"d6d13601-9b27-489a-8fa9-a0c669f75a4b","Type":"ContainerDied","Data":"27ae0053632a7f8113b665c4b253929e82367a1cad54523746ff01c51854a1d1"}
Jul 31 22:07:16.069624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.069600    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:16.211282 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.211206    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxpxk\" (UniqueName: \"kubernetes.io/projected/d6d13601-9b27-489a-8fa9-a0c669f75a4b-kube-api-access-sxpxk\") pod \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\" (UID: \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\") "
Jul 31 22:07:16.211282 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.211246    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d13601-9b27-489a-8fa9-a0c669f75a4b-config-file\") pod \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\" (UID: \"d6d13601-9b27-489a-8fa9-a0c669f75a4b\") "
Jul 31 22:07:16.211670 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.211609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6d13601-9b27-489a-8fa9-a0c669f75a4b-config-file" (OuterVolumeSpecName: "config-file") pod "d6d13601-9b27-489a-8fa9-a0c669f75a4b" (UID: "d6d13601-9b27-489a-8fa9-a0c669f75a4b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:07:16.213365 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.213342    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6d13601-9b27-489a-8fa9-a0c669f75a4b-kube-api-access-sxpxk" (OuterVolumeSpecName: "kube-api-access-sxpxk") pod "d6d13601-9b27-489a-8fa9-a0c669f75a4b" (UID: "d6d13601-9b27-489a-8fa9-a0c669f75a4b"). InnerVolumeSpecName "kube-api-access-sxpxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:16.311894 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.311857    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxpxk\" (UniqueName: \"kubernetes.io/projected/d6d13601-9b27-489a-8fa9-a0c669f75a4b-kube-api-access-sxpxk\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:07:16.311894 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.311890    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d13601-9b27-489a-8fa9-a0c669f75a4b-config-file\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:07:16.650637 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.650605    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"
Jul 31 22:07:16.650817 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.650644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-wd9tw" event={"ID":"d6d13601-9b27-489a-8fa9-a0c669f75a4b","Type":"ContainerDied","Data":"42369999f5c761ebacb4bc11a0d6bf865e825cff965f4a02e5440d4be0674eb8"}
Jul 31 22:07:16.650817 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.650698    2577 scope.go:117] "RemoveContainer" containerID="27ae0053632a7f8113b665c4b253929e82367a1cad54523746ff01c51854a1d1"
Jul 31 22:07:16.667472 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.667440    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"]
Jul 31 22:07:16.673667 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:16.673638    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-wd9tw"]
Jul 31 22:07:17.705082 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.705050    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"]
Jul 31 22:07:17.705563 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.705547    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d13601-9b27-489a-8fa9-a0c669f75a4b" containerName="limitador"
Jul 31 22:07:17.705612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.705566    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d13601-9b27-489a-8fa9-a0c669f75a4b" containerName="limitador"
Jul 31 22:07:17.705669 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.705656    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6d13601-9b27-489a-8fa9-a0c669f75a4b" containerName="limitador"
Jul 31 22:07:17.710314 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.710289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:17.715327 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.712929    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xrggg\""
Jul 31 22:07:17.715327 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.713068    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 31 22:07:17.715327 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.713787    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 31 22:07:17.715327 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.714065    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:07:17.718957 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.718924    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"]
Jul 31 22:07:17.722216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.721874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfq5f\" (UniqueName: \"kubernetes.io/projected/35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6-kube-api-access-dfq5f\") pod \"postgres-69fb4594cf-5d6c6\" (UID: \"35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:17.722216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.722008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6-data\") pod \"postgres-69fb4594cf-5d6c6\" (UID: \"35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:17.823108 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.823066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6-data\") pod \"postgres-69fb4594cf-5d6c6\" (UID: \"35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:17.823315 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.823152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfq5f\" (UniqueName: \"kubernetes.io/projected/35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6-kube-api-access-dfq5f\") pod \"postgres-69fb4594cf-5d6c6\" (UID: \"35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:17.823465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.823445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6-data\") pod \"postgres-69fb4594cf-5d6c6\" (UID: \"35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:17.833895 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:17.833868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfq5f\" (UniqueName: \"kubernetes.io/projected/35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6-kube-api-access-dfq5f\") pod \"postgres-69fb4594cf-5d6c6\" (UID: \"35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:18.028281 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:18.028154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:18.159719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:18.159694    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"]
Jul 31 22:07:18.161677 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:07:18.161646    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a2c71b_bd9a_4f45_ae72_faa7a45aa4b6.slice/crio-10e5eabfe25e56aa2a18f872714ebfc9cffe58477bf9ea70add804d360ac22d1 WatchSource:0}: Error finding container 10e5eabfe25e56aa2a18f872714ebfc9cffe58477bf9ea70add804d360ac22d1: Status 404 returned error can't find the container with id 10e5eabfe25e56aa2a18f872714ebfc9cffe58477bf9ea70add804d360ac22d1
Jul 31 22:07:18.533123 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:18.533091    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6d13601-9b27-489a-8fa9-a0c669f75a4b" path="/var/lib/kubelet/pods/d6d13601-9b27-489a-8fa9-a0c669f75a4b/volumes"
Jul 31 22:07:18.662818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:18.662782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6" event={"ID":"35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6","Type":"ContainerStarted","Data":"10e5eabfe25e56aa2a18f872714ebfc9cffe58477bf9ea70add804d360ac22d1"}
Jul 31 22:07:23.692312 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:23.692268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6" event={"ID":"35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6","Type":"ContainerStarted","Data":"2a1443e4d4c0753b385521fb8d745161d873275fe033deb79cb0e593cbdb834a"}
Jul 31 22:07:23.692739 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:23.692448    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:23.711424 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:23.711373    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6" podStartSLOduration=1.7798733690000001 podStartE2EDuration="6.711357608s" totalImagesPullingTime="4.931484239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:23.709403299 +0000 UTC m=+435.662489529" watchObservedRunningTime="2026-07-31 22:07:23.711357608 +0000 UTC m=+435.664443866"
Jul 31 22:07:29.728328 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:29.728297    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5d6c6"
Jul 31 22:07:30.568349 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.568312    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d848b977-kzp87"]
Jul 31 22:07:30.574147 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.574127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d848b977-kzp87"
Jul 31 22:07:30.577670 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.577642    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 22:07:30.577670 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.577657    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bxqgr\""
Jul 31 22:07:30.577853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.577704    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 22:07:30.579242 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.579222    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d848b977-kzp87"]
Jul 31 22:07:30.616615 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.616581    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d848b977-kzp87"]
Jul 31 22:07:30.616849 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:07:30.616829    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qztw7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d848b977-kzp87" podUID="150e1951-6ef2-4dac-9e06-832fc130a584"
Jul 31 22:07:30.637705 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.637672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qztw7\" (UniqueName: \"kubernetes.io/projected/150e1951-6ef2-4dac-9e06-832fc130a584-kube-api-access-qztw7\") pod \"authorino-6d848b977-kzp87\" (UID: \"150e1951-6ef2-4dac-9e06-832fc130a584\") " pod="kuadrant-system/authorino-6d848b977-kzp87"
Jul 31 22:07:30.734206 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.734161    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d848b977-kzp87"
Jul 31 22:07:30.738241 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.738217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qztw7\" (UniqueName: \"kubernetes.io/projected/150e1951-6ef2-4dac-9e06-832fc130a584-kube-api-access-qztw7\") pod \"authorino-6d848b977-kzp87\" (UID: \"150e1951-6ef2-4dac-9e06-832fc130a584\") " pod="kuadrant-system/authorino-6d848b977-kzp87"
Jul 31 22:07:30.740711 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.740694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d848b977-kzp87"
Jul 31 22:07:30.746076 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.746052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qztw7\" (UniqueName: \"kubernetes.io/projected/150e1951-6ef2-4dac-9e06-832fc130a584-kube-api-access-qztw7\") pod \"authorino-6d848b977-kzp87\" (UID: \"150e1951-6ef2-4dac-9e06-832fc130a584\") " pod="kuadrant-system/authorino-6d848b977-kzp87"
Jul 31 22:07:30.839490 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.839462    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qztw7\" (UniqueName: \"kubernetes.io/projected/150e1951-6ef2-4dac-9e06-832fc130a584-kube-api-access-qztw7\") pod \"150e1951-6ef2-4dac-9e06-832fc130a584\" (UID: \"150e1951-6ef2-4dac-9e06-832fc130a584\") "
Jul 31 22:07:30.841478 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.841447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150e1951-6ef2-4dac-9e06-832fc130a584-kube-api-access-qztw7" (OuterVolumeSpecName: "kube-api-access-qztw7") pod "150e1951-6ef2-4dac-9e06-832fc130a584" (UID: "150e1951-6ef2-4dac-9e06-832fc130a584"). InnerVolumeSpecName "kube-api-access-qztw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:30.940359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:30.940319    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qztw7\" (UniqueName: \"kubernetes.io/projected/150e1951-6ef2-4dac-9e06-832fc130a584-kube-api-access-qztw7\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:07:31.739552 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:31.739520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d848b977-kzp87"
Jul 31 22:07:31.771707 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:31.771664    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d848b977-kzp87"]
Jul 31 22:07:31.773972 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:31.773947    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d848b977-kzp87"]
Jul 31 22:07:32.532709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:32.532665    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150e1951-6ef2-4dac-9e06-832fc130a584" path="/var/lib/kubelet/pods/150e1951-6ef2-4dac-9e06-832fc130a584/volumes"
Jul 31 22:07:36.977977 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:36.977939    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fb6f8c475-zxv7d"]
Jul 31 22:07:36.995725 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:36.995689    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb6f8c475-zxv7d"]
Jul 31 22:07:36.995914 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:36.995825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:36.998560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:36.998529    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2qkzm\""
Jul 31 22:07:36.998560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:36.998549    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 22:07:36.998760 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:36.998584    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 22:07:37.091257 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.091217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-webhook-cert\") pod \"maas-controller-7fb6f8c475-zxv7d\" (UID: \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\") " pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:37.091452 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.091277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh9db\" (UniqueName: \"kubernetes.io/projected/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-kube-api-access-wh9db\") pod \"maas-controller-7fb6f8c475-zxv7d\" (UID: \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\") " pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:37.158970 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.158940    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75c94bd444-2n7vs"]
Jul 31 22:07:37.161248 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.161231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:37.172758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.172732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c94bd444-2n7vs"]
Jul 31 22:07:37.192569 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.192536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-webhook-cert\") pod \"maas-controller-7fb6f8c475-zxv7d\" (UID: \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\") " pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:37.192726 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.192589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh9db\" (UniqueName: \"kubernetes.io/projected/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-kube-api-access-wh9db\") pod \"maas-controller-7fb6f8c475-zxv7d\" (UID: \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\") " pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:37.195111 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.195086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-webhook-cert\") pod \"maas-controller-7fb6f8c475-zxv7d\" (UID: \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\") " pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:37.200239 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.200217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh9db\" (UniqueName: \"kubernetes.io/projected/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-kube-api-access-wh9db\") pod \"maas-controller-7fb6f8c475-zxv7d\" (UID: \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\") " pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:37.293231 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.293109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plk7f\" (UniqueName: \"kubernetes.io/projected/7371627b-ff52-4f05-ab2c-56de42471862-kube-api-access-plk7f\") pod \"maas-controller-75c94bd444-2n7vs\" (UID: \"7371627b-ff52-4f05-ab2c-56de42471862\") " pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:37.293231 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.293169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7371627b-ff52-4f05-ab2c-56de42471862-webhook-cert\") pod \"maas-controller-75c94bd444-2n7vs\" (UID: \"7371627b-ff52-4f05-ab2c-56de42471862\") " pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:37.307070 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.307036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:37.394436 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.393985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plk7f\" (UniqueName: \"kubernetes.io/projected/7371627b-ff52-4f05-ab2c-56de42471862-kube-api-access-plk7f\") pod \"maas-controller-75c94bd444-2n7vs\" (UID: \"7371627b-ff52-4f05-ab2c-56de42471862\") " pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:37.394436 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.394058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7371627b-ff52-4f05-ab2c-56de42471862-webhook-cert\") pod \"maas-controller-75c94bd444-2n7vs\" (UID: \"7371627b-ff52-4f05-ab2c-56de42471862\") " pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:37.397832 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.397802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7371627b-ff52-4f05-ab2c-56de42471862-webhook-cert\") pod \"maas-controller-75c94bd444-2n7vs\" (UID: \"7371627b-ff52-4f05-ab2c-56de42471862\") " pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:37.405039 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.405012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plk7f\" (UniqueName: \"kubernetes.io/projected/7371627b-ff52-4f05-ab2c-56de42471862-kube-api-access-plk7f\") pod \"maas-controller-75c94bd444-2n7vs\" (UID: \"7371627b-ff52-4f05-ab2c-56de42471862\") " pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:37.443309 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.443273    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb6f8c475-zxv7d"]
Jul 31 22:07:37.445214 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:07:37.445161    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d34457_e5a2_43ae_b433_b1cb6efeb4b7.slice/crio-785ca2104da2058fe0bd4b0f641055538246db30eb4fd76bb1d543fa7be3d3a6 WatchSource:0}: Error finding container 785ca2104da2058fe0bd4b0f641055538246db30eb4fd76bb1d543fa7be3d3a6: Status 404 returned error can't find the container with id 785ca2104da2058fe0bd4b0f641055538246db30eb4fd76bb1d543fa7be3d3a6
Jul 31 22:07:37.471995 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.471964    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:37.599793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.599769    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c94bd444-2n7vs"]
Jul 31 22:07:37.601795 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:07:37.601760    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7371627b_ff52_4f05_ab2c_56de42471862.slice/crio-3c3d34c79bea33efebd33a6f81c46ea07faa7d1bab845a225b8031e670fcca2e WatchSource:0}: Error finding container 3c3d34c79bea33efebd33a6f81c46ea07faa7d1bab845a225b8031e670fcca2e: Status 404 returned error can't find the container with id 3c3d34c79bea33efebd33a6f81c46ea07faa7d1bab845a225b8031e670fcca2e
Jul 31 22:07:37.770489 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.770455    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-2n7vs" event={"ID":"7371627b-ff52-4f05-ab2c-56de42471862","Type":"ContainerStarted","Data":"3c3d34c79bea33efebd33a6f81c46ea07faa7d1bab845a225b8031e670fcca2e"}
Jul 31 22:07:37.771566 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:37.771542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d" event={"ID":"30d34457-e5a2-43ae-b433-b1cb6efeb4b7","Type":"ContainerStarted","Data":"785ca2104da2058fe0bd4b0f641055538246db30eb4fd76bb1d543fa7be3d3a6"}
Jul 31 22:07:39.784646 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:39.784608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-2n7vs" event={"ID":"7371627b-ff52-4f05-ab2c-56de42471862","Type":"ContainerStarted","Data":"8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446"}
Jul 31 22:07:39.785117 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:39.784679    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:39.786098 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:39.786075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d" event={"ID":"30d34457-e5a2-43ae-b433-b1cb6efeb4b7","Type":"ContainerStarted","Data":"95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e"}
Jul 31 22:07:39.786242 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:39.786141    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:39.808098 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:39.808047    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75c94bd444-2n7vs" podStartSLOduration=1.333373407 podStartE2EDuration="2.80803094s" totalImagesPullingTime="1.474657533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:39.805931934 +0000 UTC m=+451.759018176" watchObservedRunningTime="2026-07-31 22:07:39.80803094 +0000 UTC m=+451.761117169"
Jul 31 22:07:39.826045 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:39.825990    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d" podStartSLOduration=2.191938949 podStartE2EDuration="3.825976227s" totalImagesPullingTime="1.634037278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:39.823768839 +0000 UTC m=+451.776855091" watchObservedRunningTime="2026-07-31 22:07:39.825976227 +0000 UTC m=+451.779062456"
Jul 31 22:07:50.795529 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:50.795500    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:07:50.795904 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:50.795585    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:50.866801 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:50.866767    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fb6f8c475-zxv7d"]
Jul 31 22:07:50.866988 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:50.866964    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d" podUID="30d34457-e5a2-43ae-b433-b1cb6efeb4b7" containerName="manager" containerID="cri-o://95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e" gracePeriod=30
Jul 31 22:07:51.110303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.110274    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:51.218376 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.218338    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh9db\" (UniqueName: \"kubernetes.io/projected/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-kube-api-access-wh9db\") pod \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\" (UID: \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\") "
Jul 31 22:07:51.218582 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.218397    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-webhook-cert\") pod \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\" (UID: \"30d34457-e5a2-43ae-b433-b1cb6efeb4b7\") "
Jul 31 22:07:51.220531 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.220499    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "30d34457-e5a2-43ae-b433-b1cb6efeb4b7" (UID: "30d34457-e5a2-43ae-b433-b1cb6efeb4b7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:07:51.220641 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.220578    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-kube-api-access-wh9db" (OuterVolumeSpecName: "kube-api-access-wh9db") pod "30d34457-e5a2-43ae-b433-b1cb6efeb4b7" (UID: "30d34457-e5a2-43ae-b433-b1cb6efeb4b7"). InnerVolumeSpecName "kube-api-access-wh9db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:51.319936 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.319899    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh9db\" (UniqueName: \"kubernetes.io/projected/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-kube-api-access-wh9db\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:07:51.319936 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.319931    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30d34457-e5a2-43ae-b433-b1cb6efeb4b7-webhook-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:07:51.848815 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.848777    2577 generic.go:356] "Generic (PLEG): container finished" podID="30d34457-e5a2-43ae-b433-b1cb6efeb4b7" containerID="95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e" exitCode=0
Jul 31 22:07:51.849295 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.848826    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d"
Jul 31 22:07:51.849295 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.848870    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d" event={"ID":"30d34457-e5a2-43ae-b433-b1cb6efeb4b7","Type":"ContainerDied","Data":"95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e"}
Jul 31 22:07:51.849295 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.848924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb6f8c475-zxv7d" event={"ID":"30d34457-e5a2-43ae-b433-b1cb6efeb4b7","Type":"ContainerDied","Data":"785ca2104da2058fe0bd4b0f641055538246db30eb4fd76bb1d543fa7be3d3a6"}
Jul 31 22:07:51.849295 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.848949    2577 scope.go:117] "RemoveContainer" containerID="95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e"
Jul 31 22:07:51.857987 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.857968    2577 scope.go:117] "RemoveContainer" containerID="95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e"
Jul 31 22:07:51.858288 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:07:51.858267    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e\": container with ID starting with 95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e not found: ID does not exist" containerID="95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e"
Jul 31 22:07:51.858351 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.858300    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e"} err="failed to get container status \"95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e\": rpc error: code = NotFound desc = could not find container \"95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e\": container with ID starting with 95221f22258ddfbe5a4517f1c3925df1f4167312a495ac86803ad73a4f09f33e not found: ID does not exist"
Jul 31 22:07:51.870321 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.870294    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7fb6f8c475-zxv7d"]
Jul 31 22:07:51.878422 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:51.878396    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7fb6f8c475-zxv7d"]
Jul 31 22:07:52.531543 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:07:52.531509    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30d34457-e5a2-43ae-b433-b1cb6efeb4b7" path="/var/lib/kubelet/pods/30d34457-e5a2-43ae-b433-b1cb6efeb4b7/volumes"
Jul 31 22:08:13.751010 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.750975    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"]
Jul 31 22:08:13.751498 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.751339    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30d34457-e5a2-43ae-b433-b1cb6efeb4b7" containerName="manager"
Jul 31 22:08:13.751498 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.751351    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="30d34457-e5a2-43ae-b433-b1cb6efeb4b7" containerName="manager"
Jul 31 22:08:13.751498 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.751407    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="30d34457-e5a2-43ae-b433-b1cb6efeb4b7" containerName="manager"
Jul 31 22:08:13.755899 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.755884    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.760549 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.760527    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 31 22:08:13.760693 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.760565    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lwlnd\""
Jul 31 22:08:13.776631 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.776604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"]
Jul 31 22:08:13.815036 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.815004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfg6t\" (UniqueName: \"kubernetes.io/projected/e31e9ab2-ff68-448b-bff8-254920621125-kube-api-access-wfg6t\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.815212 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.815050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e31e9ab2-ff68-448b-bff8-254920621125-openshift-service-ca\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.815212 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.815070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e31e9ab2-ff68-448b-bff8-254920621125-maas-api-tls\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.915674 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.915639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfg6t\" (UniqueName: \"kubernetes.io/projected/e31e9ab2-ff68-448b-bff8-254920621125-kube-api-access-wfg6t\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.915853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.915696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e31e9ab2-ff68-448b-bff8-254920621125-openshift-service-ca\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.915853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.915723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e31e9ab2-ff68-448b-bff8-254920621125-maas-api-tls\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.916498 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.916476    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e31e9ab2-ff68-448b-bff8-254920621125-openshift-service-ca\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.918240 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.918222    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e31e9ab2-ff68-448b-bff8-254920621125-maas-api-tls\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:13.927158 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:13.927132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfg6t\" (UniqueName: \"kubernetes.io/projected/e31e9ab2-ff68-448b-bff8-254920621125-kube-api-access-wfg6t\") pod \"maas-api-6d7bfcf6cd-t5w5t\" (UID: \"e31e9ab2-ff68-448b-bff8-254920621125\") " pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:14.065619 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.065529    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:14.203165 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.203140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"]
Jul 31 22:08:14.204975 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:08:14.204944    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31e9ab2_ff68_448b_bff8_254920621125.slice/crio-37991cc2a3f5ac254b8766f64b64a3199489e8d74b46d05b85aa1a503aa043c6 WatchSource:0}: Error finding container 37991cc2a3f5ac254b8766f64b64a3199489e8d74b46d05b85aa1a503aa043c6: Status 404 returned error can't find the container with id 37991cc2a3f5ac254b8766f64b64a3199489e8d74b46d05b85aa1a503aa043c6
Jul 31 22:08:14.469969 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.469938    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pblgj"]
Jul 31 22:08:14.474685 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.474668    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:14.477081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.477058    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k48gf\""
Jul 31 22:08:14.477221 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.477093    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 31 22:08:14.482997 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.482976    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pblgj"]
Jul 31 22:08:14.521603 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.521570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d04cdb1f-02eb-4f6f-8f28-2e98d2284f30-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pblgj\" (UID: \"d04cdb1f-02eb-4f6f-8f28-2e98d2284f30\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:14.521762 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.521615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg8fv\" (UniqueName: \"kubernetes.io/projected/d04cdb1f-02eb-4f6f-8f28-2e98d2284f30-kube-api-access-pg8fv\") pod \"payload-processing-5cc6cd444b-pblgj\" (UID: \"d04cdb1f-02eb-4f6f-8f28-2e98d2284f30\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:14.531682 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.531654    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"]
Jul 31 22:08:14.535050 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.535028    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:14.539622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.539590    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"]
Jul 31 22:08:14.622807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.622770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d04cdb1f-02eb-4f6f-8f28-2e98d2284f30-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pblgj\" (UID: \"d04cdb1f-02eb-4f6f-8f28-2e98d2284f30\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:14.622807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.622819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q65x5\" (UniqueName: \"kubernetes.io/projected/9689d533-05e6-4a5d-9d01-356c7c005b4f-kube-api-access-q65x5\") pod \"payload-pre-processing-687dbb6cf6-hm4n5\" (UID: \"9689d533-05e6-4a5d-9d01-356c7c005b4f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:14.623079 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.622939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg8fv\" (UniqueName: \"kubernetes.io/projected/d04cdb1f-02eb-4f6f-8f28-2e98d2284f30-kube-api-access-pg8fv\") pod \"payload-processing-5cc6cd444b-pblgj\" (UID: \"d04cdb1f-02eb-4f6f-8f28-2e98d2284f30\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:14.623147 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.623103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9689d533-05e6-4a5d-9d01-356c7c005b4f-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-hm4n5\" (UID: \"9689d533-05e6-4a5d-9d01-356c7c005b4f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:14.623615 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.623591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d04cdb1f-02eb-4f6f-8f28-2e98d2284f30-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-pblgj\" (UID: \"d04cdb1f-02eb-4f6f-8f28-2e98d2284f30\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:14.631034 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.631008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg8fv\" (UniqueName: \"kubernetes.io/projected/d04cdb1f-02eb-4f6f-8f28-2e98d2284f30-kube-api-access-pg8fv\") pod \"payload-processing-5cc6cd444b-pblgj\" (UID: \"d04cdb1f-02eb-4f6f-8f28-2e98d2284f30\") " pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:14.724490 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.724407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9689d533-05e6-4a5d-9d01-356c7c005b4f-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-hm4n5\" (UID: \"9689d533-05e6-4a5d-9d01-356c7c005b4f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:14.724490 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.724487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q65x5\" (UniqueName: \"kubernetes.io/projected/9689d533-05e6-4a5d-9d01-356c7c005b4f-kube-api-access-q65x5\") pod \"payload-pre-processing-687dbb6cf6-hm4n5\" (UID: \"9689d533-05e6-4a5d-9d01-356c7c005b4f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:14.725074 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.725055    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9689d533-05e6-4a5d-9d01-356c7c005b4f-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-hm4n5\" (UID: \"9689d533-05e6-4a5d-9d01-356c7c005b4f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:14.733067 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.733044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q65x5\" (UniqueName: \"kubernetes.io/projected/9689d533-05e6-4a5d-9d01-356c7c005b4f-kube-api-access-q65x5\") pod \"payload-pre-processing-687dbb6cf6-hm4n5\" (UID: \"9689d533-05e6-4a5d-9d01-356c7c005b4f\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:14.785696 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.785665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:14.847053 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.847022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:14.937438 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.937358    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-pblgj"]
Jul 31 22:08:14.940331 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:08:14.940300    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04cdb1f_02eb_4f6f_8f28_2e98d2284f30.slice/crio-078ed47ce0c42eac8df052f2da2b9be01884b70cd968cca431a95778fab623c0 WatchSource:0}: Error finding container 078ed47ce0c42eac8df052f2da2b9be01884b70cd968cca431a95778fab623c0: Status 404 returned error can't find the container with id 078ed47ce0c42eac8df052f2da2b9be01884b70cd968cca431a95778fab623c0
Jul 31 22:08:14.969763 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.969728    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj" event={"ID":"d04cdb1f-02eb-4f6f-8f28-2e98d2284f30","Type":"ContainerStarted","Data":"078ed47ce0c42eac8df052f2da2b9be01884b70cd968cca431a95778fab623c0"}
Jul 31 22:08:14.971214 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:14.971160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t" event={"ID":"e31e9ab2-ff68-448b-bff8-254920621125","Type":"ContainerStarted","Data":"37991cc2a3f5ac254b8766f64b64a3199489e8d74b46d05b85aa1a503aa043c6"}
Jul 31 22:08:15.010325 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:15.010242    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"]
Jul 31 22:08:15.014481 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:08:15.014454    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9689d533_05e6_4a5d_9d01_356c7c005b4f.slice/crio-61124d98ad7c4d055cf00a1591c91ac618fe01a6f42c298ea5e0d81a2767ceec WatchSource:0}: Error finding container 61124d98ad7c4d055cf00a1591c91ac618fe01a6f42c298ea5e0d81a2767ceec: Status 404 returned error can't find the container with id 61124d98ad7c4d055cf00a1591c91ac618fe01a6f42c298ea5e0d81a2767ceec
Jul 31 22:08:15.978663 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:15.978577    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t" event={"ID":"e31e9ab2-ff68-448b-bff8-254920621125","Type":"ContainerStarted","Data":"3e1c6879a2d6aefb88257f82b51c4c6383cf982d800f4b4c8bd22c3827265024"}
Jul 31 22:08:15.979073 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:15.978674    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:15.979798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:15.979778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5" event={"ID":"9689d533-05e6-4a5d-9d01-356c7c005b4f","Type":"ContainerStarted","Data":"61124d98ad7c4d055cf00a1591c91ac618fe01a6f42c298ea5e0d81a2767ceec"}
Jul 31 22:08:15.994550 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:15.994504    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t" podStartSLOduration=1.552612839 podStartE2EDuration="2.994490799s" totalImagesPullingTime="1.44187796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:15.993819649 +0000 UTC m=+487.946905881" watchObservedRunningTime="2026-07-31 22:08:15.994490799 +0000 UTC m=+487.947577029"
Jul 31 22:08:17.994382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:17.994348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj" event={"ID":"d04cdb1f-02eb-4f6f-8f28-2e98d2284f30","Type":"ContainerStarted","Data":"e85d60967cd4621a4537c7f8b363b0bbfb11be7dc14200247aba1394770180de"}
Jul 31 22:08:17.994710 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:17.994482    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:18.015376 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:18.015328    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj" podStartSLOduration=1.7001591619999998 podStartE2EDuration="4.015311903s" totalImagesPullingTime="2.315152741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:18.012369876 +0000 UTC m=+489.965456111" watchObservedRunningTime="2026-07-31 22:08:18.015311903 +0000 UTC m=+489.968398110"
Jul 31 22:08:19.001135 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:19.001091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5" event={"ID":"9689d533-05e6-4a5d-9d01-356c7c005b4f","Type":"ContainerStarted","Data":"10aec5ccfb5db44762dc0ac776dbeb263a867c781440d7886be5b35a2c8667fb"}
Jul 31 22:08:19.001649 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:19.001215    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:19.018775 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:19.018727    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5" podStartSLOduration=2.10252168 podStartE2EDuration="5.018710986s" totalImagesPullingTime="2.916189306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:19.016962687 +0000 UTC m=+490.970048943" watchObservedRunningTime="2026-07-31 22:08:19.018710986 +0000 UTC m=+490.971797214"
Jul 31 22:08:21.991739 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:21.991709    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d7bfcf6cd-t5w5t"
Jul 31 22:08:29.003563 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:29.003528    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-pblgj"
Jul 31 22:08:30.008748 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:30.008718    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hm4n5"
Jul 31 22:08:42.038361 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.038323    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"]
Jul 31 22:08:42.041779 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.041763    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.044395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.044367    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 22:08:42.044395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.044384    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 22:08:42.045162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.045137    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8hckp\""
Jul 31 22:08:42.045162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.045156    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 31 22:08:42.053074 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.053048    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"]
Jul 31 22:08:42.176524 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.176488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.176714 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.176532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9e63dc2-0762-4977-b967-e32638bdc61e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.176714 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.176556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6md8t\" (UniqueName: \"kubernetes.io/projected/a9e63dc2-0762-4977-b967-e32638bdc61e-kube-api-access-6md8t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.176714 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.176649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.176843 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.176715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.176843 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.176751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278073 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278255 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278255 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278255 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278128    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9e63dc2-0762-4977-b967-e32638bdc61e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278437 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6md8t\" (UniqueName: \"kubernetes.io/projected/a9e63dc2-0762-4977-b967-e32638bdc61e-kube-api-access-6md8t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278437 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278545 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278507    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278634 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.278697 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.278647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.280397 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.280372    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9e63dc2-0762-4977-b967-e32638bdc61e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.280571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.280553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9e63dc2-0762-4977-b967-e32638bdc61e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.286980 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.286954    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6md8t\" (UniqueName: \"kubernetes.io/projected/a9e63dc2-0762-4977-b967-e32638bdc61e-kube-api-access-6md8t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62\" (UID: \"a9e63dc2-0762-4977-b967-e32638bdc61e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.353002 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.352969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:42.489164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:42.489134    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"]
Jul 31 22:08:42.491136 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:08:42.491109    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e63dc2_0762_4977_b967_e32638bdc61e.slice/crio-e07c8b225c30ad7b35cf6bd8fa955ff45b5b83a937f3bdd1fb3c3b49ebb567ff WatchSource:0}: Error finding container e07c8b225c30ad7b35cf6bd8fa955ff45b5b83a937f3bdd1fb3c3b49ebb567ff: Status 404 returned error can't find the container with id e07c8b225c30ad7b35cf6bd8fa955ff45b5b83a937f3bdd1fb3c3b49ebb567ff
Jul 31 22:08:43.129897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:43.129864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62" event={"ID":"a9e63dc2-0762-4977-b967-e32638bdc61e","Type":"ContainerStarted","Data":"e07c8b225c30ad7b35cf6bd8fa955ff45b5b83a937f3bdd1fb3c3b49ebb567ff"}
Jul 31 22:08:44.137692 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:44.137650    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62" event={"ID":"a9e63dc2-0762-4977-b967-e32638bdc61e","Type":"ContainerStarted","Data":"2c10c41c6156b8158615008354c97441bb1d7a59506dceca3907c8f9b254f35e"}
Jul 31 22:08:44.156612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:44.156561    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62" podStartSLOduration=1.078269295 podStartE2EDuration="2.156546124s" totalImagesPullingTime="1.078276829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:44.155146974 +0000 UTC m=+516.108233206" watchObservedRunningTime="2026-07-31 22:08:44.156546124 +0000 UTC m=+516.109632352"
Jul 31 22:08:45.534392 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.534360    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"]
Jul 31 22:08:45.537948 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.537925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.540392 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.540365    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 31 22:08:45.557812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.557780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"]
Jul 31 22:08:45.708646 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.708611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.708830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.708671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df2c586-5a58-4be2-8d1c-ebf969c3d265-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.708830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.708759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.708830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.708817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.708958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.708875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.708958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.708902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tvs\" (UniqueName: \"kubernetes.io/projected/5df2c586-5a58-4be2-8d1c-ebf969c3d265-kube-api-access-62tvs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809451 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809451 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df2c586-5a58-4be2-8d1c-ebf969c3d265-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809451 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809490    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tvs\" (UniqueName: \"kubernetes.io/projected/5df2c586-5a58-4be2-8d1c-ebf969c3d265-kube-api-access-62tvs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809828    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.809928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.809908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.811833 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.811808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5df2c586-5a58-4be2-8d1c-ebf969c3d265-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.811995 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.811978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df2c586-5a58-4be2-8d1c-ebf969c3d265-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.817342 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.817318    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tvs\" (UniqueName: \"kubernetes.io/projected/5df2c586-5a58-4be2-8d1c-ebf969c3d265-kube-api-access-62tvs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-xcpwj\" (UID: \"5df2c586-5a58-4be2-8d1c-ebf969c3d265\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.851089 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.851048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:45.984785 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:45.984760    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"]
Jul 31 22:08:45.986865 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:08:45.986835    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df2c586_5a58_4be2_8d1c_ebf969c3d265.slice/crio-248a4ef7a6bfe60957efec4b532ea0b651c50452cae8ca2bf5da1de4c5cd74c3 WatchSource:0}: Error finding container 248a4ef7a6bfe60957efec4b532ea0b651c50452cae8ca2bf5da1de4c5cd74c3: Status 404 returned error can't find the container with id 248a4ef7a6bfe60957efec4b532ea0b651c50452cae8ca2bf5da1de4c5cd74c3
Jul 31 22:08:46.148695 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:46.148663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj" event={"ID":"5df2c586-5a58-4be2-8d1c-ebf969c3d265","Type":"ContainerStarted","Data":"248a4ef7a6bfe60957efec4b532ea0b651c50452cae8ca2bf5da1de4c5cd74c3"}
Jul 31 22:08:47.155652 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:47.155614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj" event={"ID":"5df2c586-5a58-4be2-8d1c-ebf969c3d265","Type":"ContainerStarted","Data":"8f8bf8ea849c53e50ff3c040cfae514d713d2308300118dfc906ab7bde4f4dc0"}
Jul 31 22:08:47.181356 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:47.181303    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj" podStartSLOduration=1.844644033 podStartE2EDuration="2.181284612s" totalImagesPullingTime="336.640579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:47.178562734 +0000 UTC m=+519.131648984" watchObservedRunningTime="2026-07-31 22:08:47.181284612 +0000 UTC m=+519.134370842"
Jul 31 22:08:52.353530 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:52.353479    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:52.353918 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:52.353565    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:52.366014 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:52.365984    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:53.198555 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:53.198520    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62"
Jul 31 22:08:55.851757 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:55.851718    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:55.852142 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:55.851796    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:55.864514 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:55.864482    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:08:56.214436 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:08:56.214355    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-xcpwj"
Jul 31 22:09:16.544865 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.544785    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"]
Jul 31 22:09:16.547519 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.547499    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.549919 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.549900    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 31 22:09:16.556378 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.556349    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"]
Jul 31 22:09:16.648223 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.648149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxjj\" (UniqueName: \"kubernetes.io/projected/eeff90ca-b2e6-4c7f-b280-69713e697ff2-kube-api-access-rpxjj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.648398 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.648259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.648398 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.648289    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.648398 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.648323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeff90ca-b2e6-4c7f-b280-69713e697ff2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.648398 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.648351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.648546 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.648419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.749392 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.749352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.749574 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.749418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxjj\" (UniqueName: \"kubernetes.io/projected/eeff90ca-b2e6-4c7f-b280-69713e697ff2-kube-api-access-rpxjj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.749574 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.749463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.749574 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.749492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.749574 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.749528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeff90ca-b2e6-4c7f-b280-69713e697ff2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.749574 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.749556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.749861 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.749797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.749861 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.749816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.750025 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.750002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.751796 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.751775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eeff90ca-b2e6-4c7f-b280-69713e697ff2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.752108 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.752089    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eeff90ca-b2e6-4c7f-b280-69713e697ff2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.757088 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.757068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxjj\" (UniqueName: \"kubernetes.io/projected/eeff90ca-b2e6-4c7f-b280-69713e697ff2-kube-api-access-rpxjj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k5j6c\" (UID: \"eeff90ca-b2e6-4c7f-b280-69713e697ff2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.858125 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.858088    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:16.994504 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:16.994473    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"]
Jul 31 22:09:16.995907 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:09:16.995883    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeff90ca_b2e6_4c7f_b280_69713e697ff2.slice/crio-aeb8415b40f8a5ab62fcee779339193137c6b88f4cfd2cd1d5f172f2bb9a4e41 WatchSource:0}: Error finding container aeb8415b40f8a5ab62fcee779339193137c6b88f4cfd2cd1d5f172f2bb9a4e41: Status 404 returned error can't find the container with id aeb8415b40f8a5ab62fcee779339193137c6b88f4cfd2cd1d5f172f2bb9a4e41
Jul 31 22:09:17.312720 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:17.312690    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c" event={"ID":"eeff90ca-b2e6-4c7f-b280-69713e697ff2","Type":"ContainerStarted","Data":"ab531522e892455a39a9cbb59e9ec37c9426a2e1cd7464becc08160572350e1c"}
Jul 31 22:09:17.312916 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:17.312744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c" event={"ID":"eeff90ca-b2e6-4c7f-b280-69713e697ff2","Type":"ContainerStarted","Data":"aeb8415b40f8a5ab62fcee779339193137c6b88f4cfd2cd1d5f172f2bb9a4e41"}
Jul 31 22:09:17.342858 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:17.342804    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c" podStartSLOduration=1.178633545 podStartE2EDuration="1.342784752s" totalImagesPullingTime="164.151207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:09:17.34100422 +0000 UTC m=+549.294090470" watchObservedRunningTime="2026-07-31 22:09:17.342784752 +0000 UTC m=+549.295870981"
Jul 31 22:09:26.858992 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:26.858959    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:26.859474 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:26.859217    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:26.871762 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:26.871735    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:09:27.382796 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:09:27.382762    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k5j6c"
Jul 31 22:11:38.523709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.523671    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75c94bd444-2n7vs"]
Jul 31 22:11:38.524274 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.523916    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75c94bd444-2n7vs" podUID="7371627b-ff52-4f05-ab2c-56de42471862" containerName="manager" containerID="cri-o://8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446" gracePeriod=30
Jul 31 22:11:38.777402 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.777340    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:11:38.825561 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.825526    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7371627b-ff52-4f05-ab2c-56de42471862-webhook-cert\") pod \"7371627b-ff52-4f05-ab2c-56de42471862\" (UID: \"7371627b-ff52-4f05-ab2c-56de42471862\") "
Jul 31 22:11:38.825747 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.825625    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plk7f\" (UniqueName: \"kubernetes.io/projected/7371627b-ff52-4f05-ab2c-56de42471862-kube-api-access-plk7f\") pod \"7371627b-ff52-4f05-ab2c-56de42471862\" (UID: \"7371627b-ff52-4f05-ab2c-56de42471862\") "
Jul 31 22:11:38.827819 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.827787    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7371627b-ff52-4f05-ab2c-56de42471862-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7371627b-ff52-4f05-ab2c-56de42471862" (UID: "7371627b-ff52-4f05-ab2c-56de42471862"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:11:38.827819 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.827801    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7371627b-ff52-4f05-ab2c-56de42471862-kube-api-access-plk7f" (OuterVolumeSpecName: "kube-api-access-plk7f") pod "7371627b-ff52-4f05-ab2c-56de42471862" (UID: "7371627b-ff52-4f05-ab2c-56de42471862"). InnerVolumeSpecName "kube-api-access-plk7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:11:38.926663 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.926628    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7371627b-ff52-4f05-ab2c-56de42471862-webhook-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:11:38.926663 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:38.926657    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plk7f\" (UniqueName: \"kubernetes.io/projected/7371627b-ff52-4f05-ab2c-56de42471862-kube-api-access-plk7f\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:11:39.075378 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.075284    2577 generic.go:356] "Generic (PLEG): container finished" podID="7371627b-ff52-4f05-ab2c-56de42471862" containerID="8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446" exitCode=0
Jul 31 22:11:39.075378 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.075338    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-2n7vs"
Jul 31 22:11:39.075570 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.075382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-2n7vs" event={"ID":"7371627b-ff52-4f05-ab2c-56de42471862","Type":"ContainerDied","Data":"8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446"}
Jul 31 22:11:39.075570 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.075441    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-2n7vs" event={"ID":"7371627b-ff52-4f05-ab2c-56de42471862","Type":"ContainerDied","Data":"3c3d34c79bea33efebd33a6f81c46ea07faa7d1bab845a225b8031e670fcca2e"}
Jul 31 22:11:39.075570 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.075470    2577 scope.go:117] "RemoveContainer" containerID="8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446"
Jul 31 22:11:39.084753 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.084733    2577 scope.go:117] "RemoveContainer" containerID="8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446"
Jul 31 22:11:39.084984 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:11:39.084966    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446\": container with ID starting with 8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446 not found: ID does not exist" containerID="8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446"
Jul 31 22:11:39.085038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.084993    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446"} err="failed to get container status \"8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446\": rpc error: code = NotFound desc = could not find container \"8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446\": container with ID starting with 8d5a18de1bbe677f1b387156cf03bf3c1de2d7d89042fc015bedf07c11a6b446 not found: ID does not exist"
Jul 31 22:11:39.098952 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.098922    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75c94bd444-2n7vs"]
Jul 31 22:11:39.108308 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:39.108281    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75c94bd444-2n7vs"]
Jul 31 22:11:40.532601 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:11:40.532569    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7371627b-ff52-4f05-ab2c-56de42471862" path="/var/lib/kubelet/pods/7371627b-ff52-4f05-ab2c-56de42471862/volumes"
Jul 31 22:12:39.953226 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.953169    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75c94bd444-b5hbq"]
Jul 31 22:12:39.953744 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.953569    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7371627b-ff52-4f05-ab2c-56de42471862" containerName="manager"
Jul 31 22:12:39.953744 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.953579    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7371627b-ff52-4f05-ab2c-56de42471862" containerName="manager"
Jul 31 22:12:39.953744 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.953649    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7371627b-ff52-4f05-ab2c-56de42471862" containerName="manager"
Jul 31 22:12:39.956411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.956397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:39.959077 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.959055    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 22:12:39.959745 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.959730    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 22:12:39.959835 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.959734    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2qkzm\""
Jul 31 22:12:39.969046 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:39.969014    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c94bd444-b5hbq"]
Jul 31 22:12:40.055594 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.055551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92r27\" (UniqueName: \"kubernetes.io/projected/2085338f-3ead-4c6c-b330-12eda08aace0-kube-api-access-92r27\") pod \"maas-controller-75c94bd444-b5hbq\" (UID: \"2085338f-3ead-4c6c-b330-12eda08aace0\") " pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:40.055774 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.055693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2085338f-3ead-4c6c-b330-12eda08aace0-webhook-cert\") pod \"maas-controller-75c94bd444-b5hbq\" (UID: \"2085338f-3ead-4c6c-b330-12eda08aace0\") " pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:40.156522 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.156487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2085338f-3ead-4c6c-b330-12eda08aace0-webhook-cert\") pod \"maas-controller-75c94bd444-b5hbq\" (UID: \"2085338f-3ead-4c6c-b330-12eda08aace0\") " pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:40.156656 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.156539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92r27\" (UniqueName: \"kubernetes.io/projected/2085338f-3ead-4c6c-b330-12eda08aace0-kube-api-access-92r27\") pod \"maas-controller-75c94bd444-b5hbq\" (UID: \"2085338f-3ead-4c6c-b330-12eda08aace0\") " pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:40.159097 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.159066    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2085338f-3ead-4c6c-b330-12eda08aace0-webhook-cert\") pod \"maas-controller-75c94bd444-b5hbq\" (UID: \"2085338f-3ead-4c6c-b330-12eda08aace0\") " pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:40.165261 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.165240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92r27\" (UniqueName: \"kubernetes.io/projected/2085338f-3ead-4c6c-b330-12eda08aace0-kube-api-access-92r27\") pod \"maas-controller-75c94bd444-b5hbq\" (UID: \"2085338f-3ead-4c6c-b330-12eda08aace0\") " pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:40.267159 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.267075    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:40.401546 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.401520    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c94bd444-b5hbq"]
Jul 31 22:12:40.404341 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:12:40.404309    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2085338f_3ead_4c6c_b330_12eda08aace0.slice/crio-e5371ba93f34f52bbfedbfc88da51884eabedefa663f9ec7214ec5b8516834c5 WatchSource:0}: Error finding container e5371ba93f34f52bbfedbfc88da51884eabedefa663f9ec7214ec5b8516834c5: Status 404 returned error can't find the container with id e5371ba93f34f52bbfedbfc88da51884eabedefa663f9ec7214ec5b8516834c5
Jul 31 22:12:40.405562 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:40.405544    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:12:41.411698 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:41.411662    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-b5hbq" event={"ID":"2085338f-3ead-4c6c-b330-12eda08aace0","Type":"ContainerStarted","Data":"4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71"}
Jul 31 22:12:41.412075 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:41.411714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-b5hbq" event={"ID":"2085338f-3ead-4c6c-b330-12eda08aace0","Type":"ContainerStarted","Data":"e5371ba93f34f52bbfedbfc88da51884eabedefa663f9ec7214ec5b8516834c5"}
Jul 31 22:12:41.412075 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:41.411771    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:41.429865 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:41.429816    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75c94bd444-b5hbq" podStartSLOduration=1.821109192 podStartE2EDuration="2.429800749s" totalImagesPullingTime="608.691557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:12:41.428108234 +0000 UTC m=+753.381194463" watchObservedRunningTime="2026-07-31 22:12:41.429800749 +0000 UTC m=+753.382886978"
Jul 31 22:12:52.422200 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:52.422145    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:57.086486 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.086447    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75c94bd444-b5hbq"]
Jul 31 22:12:57.086944 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.086660    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75c94bd444-b5hbq" podUID="2085338f-3ead-4c6c-b330-12eda08aace0" containerName="manager" containerID="cri-o://4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71" gracePeriod=30
Jul 31 22:12:57.341027 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.340961    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:57.412312 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.412283    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2085338f-3ead-4c6c-b330-12eda08aace0-webhook-cert\") pod \"2085338f-3ead-4c6c-b330-12eda08aace0\" (UID: \"2085338f-3ead-4c6c-b330-12eda08aace0\") "
Jul 31 22:12:57.412478 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.412359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92r27\" (UniqueName: \"kubernetes.io/projected/2085338f-3ead-4c6c-b330-12eda08aace0-kube-api-access-92r27\") pod \"2085338f-3ead-4c6c-b330-12eda08aace0\" (UID: \"2085338f-3ead-4c6c-b330-12eda08aace0\") "
Jul 31 22:12:57.414401 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.414364    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2085338f-3ead-4c6c-b330-12eda08aace0-kube-api-access-92r27" (OuterVolumeSpecName: "kube-api-access-92r27") pod "2085338f-3ead-4c6c-b330-12eda08aace0" (UID: "2085338f-3ead-4c6c-b330-12eda08aace0"). InnerVolumeSpecName "kube-api-access-92r27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:12:57.414526 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.414416    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2085338f-3ead-4c6c-b330-12eda08aace0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2085338f-3ead-4c6c-b330-12eda08aace0" (UID: "2085338f-3ead-4c6c-b330-12eda08aace0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:12:57.499516 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.499480    2577 generic.go:356] "Generic (PLEG): container finished" podID="2085338f-3ead-4c6c-b330-12eda08aace0" containerID="4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71" exitCode=0
Jul 31 22:12:57.499722 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.499523    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-b5hbq"
Jul 31 22:12:57.499722 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.499575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-b5hbq" event={"ID":"2085338f-3ead-4c6c-b330-12eda08aace0","Type":"ContainerDied","Data":"4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71"}
Jul 31 22:12:57.499722 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.499637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-b5hbq" event={"ID":"2085338f-3ead-4c6c-b330-12eda08aace0","Type":"ContainerDied","Data":"e5371ba93f34f52bbfedbfc88da51884eabedefa663f9ec7214ec5b8516834c5"}
Jul 31 22:12:57.499722 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.499671    2577 scope.go:117] "RemoveContainer" containerID="4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71"
Jul 31 22:12:57.508830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.508816    2577 scope.go:117] "RemoveContainer" containerID="4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71"
Jul 31 22:12:57.509071 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:12:57.509053    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71\": container with ID starting with 4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71 not found: ID does not exist" containerID="4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71"
Jul 31 22:12:57.509115 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.509079    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71"} err="failed to get container status \"4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71\": rpc error: code = NotFound desc = could not find container \"4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71\": container with ID starting with 4960f0b1af85bd5be12750cc743cf2bd1616be55a599faa9c097be20d4f04b71 not found: ID does not exist"
Jul 31 22:12:57.513546 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.513530    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2085338f-3ead-4c6c-b330-12eda08aace0-webhook-cert\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:12:57.513612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.513549    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92r27\" (UniqueName: \"kubernetes.io/projected/2085338f-3ead-4c6c-b330-12eda08aace0-kube-api-access-92r27\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:12:57.527000 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.526979    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75c94bd444-b5hbq"]
Jul 31 22:12:57.530432 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:57.530411    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75c94bd444-b5hbq"]
Jul 31 22:12:58.336468 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.336423    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75c94bd444-jlhl9"]
Jul 31 22:12:58.337292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.337268    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2085338f-3ead-4c6c-b330-12eda08aace0" containerName="manager"
Jul 31 22:12:58.337292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.337294    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2085338f-3ead-4c6c-b330-12eda08aace0" containerName="manager"
Jul 31 22:12:58.337531 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.337517    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2085338f-3ead-4c6c-b330-12eda08aace0" containerName="manager"
Jul 31 22:12:58.343219 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.343193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:58.345928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.345906    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 31 22:12:58.346566 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.346546    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 31 22:12:58.346667 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.346547    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2qkzm\""
Jul 31 22:12:58.346919 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.346898    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c94bd444-jlhl9"]
Jul 31 22:12:58.422171 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.422140    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee406bb6-2c6b-4162-804f-e36f8884eaba-webhook-cert\") pod \"maas-controller-75c94bd444-jlhl9\" (UID: \"ee406bb6-2c6b-4162-804f-e36f8884eaba\") " pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:58.422359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.422330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qbjb\" (UniqueName: \"kubernetes.io/projected/ee406bb6-2c6b-4162-804f-e36f8884eaba-kube-api-access-5qbjb\") pod \"maas-controller-75c94bd444-jlhl9\" (UID: \"ee406bb6-2c6b-4162-804f-e36f8884eaba\") " pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:58.523491 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.523406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qbjb\" (UniqueName: \"kubernetes.io/projected/ee406bb6-2c6b-4162-804f-e36f8884eaba-kube-api-access-5qbjb\") pod \"maas-controller-75c94bd444-jlhl9\" (UID: \"ee406bb6-2c6b-4162-804f-e36f8884eaba\") " pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:58.523491 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.523453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee406bb6-2c6b-4162-804f-e36f8884eaba-webhook-cert\") pod \"maas-controller-75c94bd444-jlhl9\" (UID: \"ee406bb6-2c6b-4162-804f-e36f8884eaba\") " pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:58.525883 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.525861    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee406bb6-2c6b-4162-804f-e36f8884eaba-webhook-cert\") pod \"maas-controller-75c94bd444-jlhl9\" (UID: \"ee406bb6-2c6b-4162-804f-e36f8884eaba\") " pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:58.533574 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.533548    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2085338f-3ead-4c6c-b330-12eda08aace0" path="/var/lib/kubelet/pods/2085338f-3ead-4c6c-b330-12eda08aace0/volumes"
Jul 31 22:12:58.536987 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.536962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qbjb\" (UniqueName: \"kubernetes.io/projected/ee406bb6-2c6b-4162-804f-e36f8884eaba-kube-api-access-5qbjb\") pod \"maas-controller-75c94bd444-jlhl9\" (UID: \"ee406bb6-2c6b-4162-804f-e36f8884eaba\") " pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:58.655468 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.655429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:58.799520 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:58.799444    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c94bd444-jlhl9"]
Jul 31 22:12:58.802603 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:12:58.802575    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee406bb6_2c6b_4162_804f_e36f8884eaba.slice/crio-23ed170d9d0e18a912744184992d63197383e6150cb2cfaea5f6b386e976425e WatchSource:0}: Error finding container 23ed170d9d0e18a912744184992d63197383e6150cb2cfaea5f6b386e976425e: Status 404 returned error can't find the container with id 23ed170d9d0e18a912744184992d63197383e6150cb2cfaea5f6b386e976425e
Jul 31 22:12:59.513628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:59.513538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-jlhl9" event={"ID":"ee406bb6-2c6b-4162-804f-e36f8884eaba","Type":"ContainerStarted","Data":"6f94176005014462ebc98f617448e1cf19994956dcf84a490498253f3123c11c"}
Jul 31 22:12:59.513628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:59.513590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c94bd444-jlhl9" event={"ID":"ee406bb6-2c6b-4162-804f-e36f8884eaba","Type":"ContainerStarted","Data":"23ed170d9d0e18a912744184992d63197383e6150cb2cfaea5f6b386e976425e"}
Jul 31 22:12:59.513628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:59.513629    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:12:59.532133 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:12:59.532083    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75c94bd444-jlhl9" podStartSLOduration=1.216252525 podStartE2EDuration="1.532067633s" totalImagesPullingTime="315.815108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:12:59.53037629 +0000 UTC m=+771.483462532" watchObservedRunningTime="2026-07-31 22:12:59.532067633 +0000 UTC m=+771.485153861"
Jul 31 22:13:10.521874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:13:10.521846    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75c94bd444-jlhl9"
Jul 31 22:28:10.744768 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.744727    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"]
Jul 31 22:28:10.752691 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.750817    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:10.755592 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.755561    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-48fa749f-serving-cert\""
Jul 31 22:28:10.758658 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.758617    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"]
Jul 31 22:28:10.802752 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.802722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc9rq\" (UniqueName: \"kubernetes.io/projected/c6961827-0898-4b29-b2d2-64f4e525d710-kube-api-access-bc9rq\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:10.802916 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.802817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:10.802916 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.802857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6961827-0898-4b29-b2d2-64f4e525d710-openshift-service-ca\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:10.903491 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.903450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:10.903690 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.903502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6961827-0898-4b29-b2d2-64f4e525d710-openshift-service-ca\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:10.903690 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.903538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc9rq\" (UniqueName: \"kubernetes.io/projected/c6961827-0898-4b29-b2d2-64f4e525d710-kube-api-access-bc9rq\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:10.903690 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:28:10.903632    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-serving-cert: secret "maas-api-e2e-ait-48fa749f-serving-cert" not found
Jul 31 22:28:10.903872 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:28:10.903728    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls podName:c6961827-0898-4b29-b2d2-64f4e525d710 nodeName:}" failed. No retries permitted until 2026-07-31 22:28:11.403702818 +0000 UTC m=+1683.356789031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls") pod "maas-api-e2e-ait-48fa749f-55d74d77b-72s4g" (UID: "c6961827-0898-4b29-b2d2-64f4e525d710") : secret "maas-api-e2e-ait-48fa749f-serving-cert" not found
Jul 31 22:28:10.904212 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.904165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6961827-0898-4b29-b2d2-64f4e525d710-openshift-service-ca\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:10.914058 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:10.914016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc9rq\" (UniqueName: \"kubernetes.io/projected/c6961827-0898-4b29-b2d2-64f4e525d710-kube-api-access-bc9rq\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:11.400390 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.400353    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"]
Jul 31 22:28:11.403980 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.403963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:11.406279 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.406260    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-48fa749f-dockercfg-226zh\""
Jul 31 22:28:11.406379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.406304    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-48fa749f\""
Jul 31 22:28:11.408504 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.408480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:11.411097 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.411066    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls\") pod \"maas-api-e2e-ait-48fa749f-55d74d77b-72s4g\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:11.414751 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.414731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"]
Jul 31 22:28:11.424439 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.424408    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"]
Jul 31 22:28:11.428782 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.428764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:11.446757 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.446728    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"]
Jul 31 22:28:11.509287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.509253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn\" (UID: \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:11.509461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.509293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhbvk\" (UniqueName: \"kubernetes.io/projected/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-kube-api-access-zhbvk\") pod \"payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn\" (UID: \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:11.509461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.509411    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-plugins-config-volume\") pod \"payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6\" (UID: \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\") " pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:11.509461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.509457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvjsg\" (UniqueName: \"kubernetes.io/projected/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-kube-api-access-zvjsg\") pod \"payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6\" (UID: \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\") " pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:11.610665 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.610612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-plugins-config-volume\") pod \"payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6\" (UID: \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\") " pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:11.610904 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.610821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvjsg\" (UniqueName: \"kubernetes.io/projected/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-kube-api-access-zvjsg\") pod \"payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6\" (UID: \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\") " pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:11.610983 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.610957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn\" (UID: \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:11.611073 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.610992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhbvk\" (UniqueName: \"kubernetes.io/projected/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-kube-api-access-zhbvk\") pod \"payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn\" (UID: \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:11.611478 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.611453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-plugins-config-volume\") pod \"payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6\" (UID: \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\") " pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:11.611682 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.611663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn\" (UID: \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:11.618968 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.618941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvjsg\" (UniqueName: \"kubernetes.io/projected/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-kube-api-access-zvjsg\") pod \"payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6\" (UID: \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\") " pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:11.619062 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.618941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhbvk\" (UniqueName: \"kubernetes.io/projected/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-kube-api-access-zhbvk\") pod \"payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn\" (UID: \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:11.666538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.666453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:11.725036 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.725002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:11.738687 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.738638    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:11.856133 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.855784    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"]
Jul 31 22:28:11.859928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:11.859895    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:28:12.089245 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.089212    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"]
Jul 31 22:28:12.090567 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:28:12.090539    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6035ec9_e0c6_4041_8767_5de3a1d60d7d.slice/crio-4e368237b8e3393a35d4fc680f747a3ab96f76a5acd2e5b47c95ad565b358ebf WatchSource:0}: Error finding container 4e368237b8e3393a35d4fc680f747a3ab96f76a5acd2e5b47c95ad565b358ebf: Status 404 returned error can't find the container with id 4e368237b8e3393a35d4fc680f747a3ab96f76a5acd2e5b47c95ad565b358ebf
Jul 31 22:28:12.118300 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.118274    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"]
Jul 31 22:28:12.133394 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:28:12.133365    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcaa5289_811a_45d3_a8b9_3af95e8f12d0.slice/crio-7792bc49f25ef1fa8d59e9beaeb502dd75562a4459d4d10875e5c6d0fc24e955 WatchSource:0}: Error finding container 7792bc49f25ef1fa8d59e9beaeb502dd75562a4459d4d10875e5c6d0fc24e955: Status 404 returned error can't find the container with id 7792bc49f25ef1fa8d59e9beaeb502dd75562a4459d4d10875e5c6d0fc24e955
Jul 31 22:28:12.332357 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.332316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6" event={"ID":"fcaa5289-811a-45d3-a8b9-3af95e8f12d0","Type":"ContainerStarted","Data":"f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12"}
Jul 31 22:28:12.332513 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.332382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6" event={"ID":"fcaa5289-811a-45d3-a8b9-3af95e8f12d0","Type":"ContainerStarted","Data":"7792bc49f25ef1fa8d59e9beaeb502dd75562a4459d4d10875e5c6d0fc24e955"}
Jul 31 22:28:12.332513 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.332500    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:12.333619 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.333595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g" event={"ID":"c6961827-0898-4b29-b2d2-64f4e525d710","Type":"ContainerStarted","Data":"995e24604402439f43c6df374041fbd30fa7c55bf46a01825150dd32756afb1c"}
Jul 31 22:28:12.335027 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.335004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn" event={"ID":"d6035ec9-e0c6-4041-8767-5de3a1d60d7d","Type":"ContainerStarted","Data":"c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903"}
Jul 31 22:28:12.335145 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.335046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn" event={"ID":"d6035ec9-e0c6-4041-8767-5de3a1d60d7d","Type":"ContainerStarted","Data":"4e368237b8e3393a35d4fc680f747a3ab96f76a5acd2e5b47c95ad565b358ebf"}
Jul 31 22:28:12.335145 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.335069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:12.349322 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.349060    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6" podStartSLOduration=1.349042209 podStartE2EDuration="1.349042209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:28:12.348530585 +0000 UTC m=+1684.301616815" watchObservedRunningTime="2026-07-31 22:28:12.349042209 +0000 UTC m=+1684.302128438"
Jul 31 22:28:12.365676 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:12.365614    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn" podStartSLOduration=1.365596933 podStartE2EDuration="1.365596933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:28:12.363791205 +0000 UTC m=+1684.316877433" watchObservedRunningTime="2026-07-31 22:28:12.365596933 +0000 UTC m=+1684.318683168"
Jul 31 22:28:13.342314 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:13.342277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g" event={"ID":"c6961827-0898-4b29-b2d2-64f4e525d710","Type":"ContainerStarted","Data":"bba87cb5799afa22e73bfa66695558f6c7a082bf0a586d6e0c51233edeefa116"}
Jul 31 22:28:13.342740 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:13.342342    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:19.353582 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:19.353553    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:19.372219 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:19.372148    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g" podStartSLOduration=8.805064804 podStartE2EDuration="9.372131767s" totalImagesPullingTime="567.066963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:28:13.35882998 +0000 UTC m=+1685.311916209" watchObservedRunningTime="2026-07-31 22:28:19.372131767 +0000 UTC m=+1691.325217995"
Jul 31 22:28:23.344280 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:23.344250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:23.344750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:23.344322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:51.410059 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.410022    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"]
Jul 31 22:28:51.412757 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.410295    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g" podUID="c6961827-0898-4b29-b2d2-64f4e525d710" containerName="maas-api" containerID="cri-o://bba87cb5799afa22e73bfa66695558f6c7a082bf0a586d6e0c51233edeefa116" gracePeriod=30
Jul 31 22:28:51.471315 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.471274    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"]
Jul 31 22:28:51.471585 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.471525    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6" podUID="fcaa5289-811a-45d3-a8b9-3af95e8f12d0" containerName="payload-processing" containerID="cri-o://f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12" gracePeriod=30
Jul 31 22:28:51.477774 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.477744    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"]
Jul 31 22:28:51.478026 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.477976    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn" podUID="d6035ec9-e0c6-4041-8767-5de3a1d60d7d" containerName="payload-pre-processing" containerID="cri-o://c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903" gracePeriod=30
Jul 31 22:28:51.548412 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.548378    2577 generic.go:356] "Generic (PLEG): container finished" podID="c6961827-0898-4b29-b2d2-64f4e525d710" containerID="bba87cb5799afa22e73bfa66695558f6c7a082bf0a586d6e0c51233edeefa116" exitCode=0
Jul 31 22:28:51.548590 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.548455    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g" event={"ID":"c6961827-0898-4b29-b2d2-64f4e525d710","Type":"ContainerDied","Data":"bba87cb5799afa22e73bfa66695558f6c7a082bf0a586d6e0c51233edeefa116"}
Jul 31 22:28:51.736471 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.736394    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:51.762980 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.762950    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:51.787406 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.787380    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc9rq\" (UniqueName: \"kubernetes.io/projected/c6961827-0898-4b29-b2d2-64f4e525d710-kube-api-access-bc9rq\") pod \"c6961827-0898-4b29-b2d2-64f4e525d710\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") "
Jul 31 22:28:51.787580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.787478    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls\") pod \"c6961827-0898-4b29-b2d2-64f4e525d710\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") "
Jul 31 22:28:51.787580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.787504    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6961827-0898-4b29-b2d2-64f4e525d710-openshift-service-ca\") pod \"c6961827-0898-4b29-b2d2-64f4e525d710\" (UID: \"c6961827-0898-4b29-b2d2-64f4e525d710\") "
Jul 31 22:28:51.787580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.787539    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-plugins-config-volume\") pod \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\" (UID: \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\") "
Jul 31 22:28:51.787580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.787557    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvjsg\" (UniqueName: \"kubernetes.io/projected/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-kube-api-access-zvjsg\") pod \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\" (UID: \"fcaa5289-811a-45d3-a8b9-3af95e8f12d0\") "
Jul 31 22:28:51.787953 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.787924    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6961827-0898-4b29-b2d2-64f4e525d710-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6961827-0898-4b29-b2d2-64f4e525d710" (UID: "c6961827-0898-4b29-b2d2-64f4e525d710"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:28:51.787953 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.787935    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fcaa5289-811a-45d3-a8b9-3af95e8f12d0" (UID: "fcaa5289-811a-45d3-a8b9-3af95e8f12d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:28:51.788215 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.788198    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6961827-0898-4b29-b2d2-64f4e525d710-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:28:51.788293 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.788222    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:28:51.789757 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.789724    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6961827-0898-4b29-b2d2-64f4e525d710-kube-api-access-bc9rq" (OuterVolumeSpecName: "kube-api-access-bc9rq") pod "c6961827-0898-4b29-b2d2-64f4e525d710" (UID: "c6961827-0898-4b29-b2d2-64f4e525d710"). InnerVolumeSpecName "kube-api-access-bc9rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:28:51.789870 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.789833    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:51.790099 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.790069    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6961827-0898-4b29-b2d2-64f4e525d710" (UID: "c6961827-0898-4b29-b2d2-64f4e525d710"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:28:51.790151 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.790114    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-kube-api-access-zvjsg" (OuterVolumeSpecName: "kube-api-access-zvjsg") pod "fcaa5289-811a-45d3-a8b9-3af95e8f12d0" (UID: "fcaa5289-811a-45d3-a8b9-3af95e8f12d0"). InnerVolumeSpecName "kube-api-access-zvjsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:28:51.889121 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.889091    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-plugins-config-volume\") pod \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\" (UID: \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\") "
Jul 31 22:28:51.889334 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.889258    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhbvk\" (UniqueName: \"kubernetes.io/projected/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-kube-api-access-zhbvk\") pod \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\" (UID: \"d6035ec9-e0c6-4041-8767-5de3a1d60d7d\") "
Jul 31 22:28:51.889486 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.889463    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6035ec9-e0c6-4041-8767-5de3a1d60d7d" (UID: "d6035ec9-e0c6-4041-8767-5de3a1d60d7d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:28:51.889560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.889510    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvjsg\" (UniqueName: \"kubernetes.io/projected/fcaa5289-811a-45d3-a8b9-3af95e8f12d0-kube-api-access-zvjsg\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:28:51.889560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.889532    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc9rq\" (UniqueName: \"kubernetes.io/projected/c6961827-0898-4b29-b2d2-64f4e525d710-kube-api-access-bc9rq\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:28:51.889560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.889547    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6961827-0898-4b29-b2d2-64f4e525d710-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:28:51.891258 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.891239    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-kube-api-access-zhbvk" (OuterVolumeSpecName: "kube-api-access-zhbvk") pod "d6035ec9-e0c6-4041-8767-5de3a1d60d7d" (UID: "d6035ec9-e0c6-4041-8767-5de3a1d60d7d"). InnerVolumeSpecName "kube-api-access-zhbvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:28:51.990620 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.990532    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhbvk\" (UniqueName: \"kubernetes.io/projected/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-kube-api-access-zhbvk\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:28:51.990620 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:51.990558    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6035ec9-e0c6-4041-8767-5de3a1d60d7d-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:28:52.555063 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.555036    2577 generic.go:356] "Generic (PLEG): container finished" podID="fcaa5289-811a-45d3-a8b9-3af95e8f12d0" containerID="f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12" exitCode=0
Jul 31 22:28:52.555442 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.555078    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"
Jul 31 22:28:52.555442 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.555129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6" event={"ID":"fcaa5289-811a-45d3-a8b9-3af95e8f12d0","Type":"ContainerDied","Data":"f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12"}
Jul 31 22:28:52.555442 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.555194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6" event={"ID":"fcaa5289-811a-45d3-a8b9-3af95e8f12d0","Type":"ContainerDied","Data":"7792bc49f25ef1fa8d59e9beaeb502dd75562a4459d4d10875e5c6d0fc24e955"}
Jul 31 22:28:52.555442 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.555218    2577 scope.go:117] "RemoveContainer" containerID="f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12"
Jul 31 22:28:52.556569 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.556552    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"
Jul 31 22:28:52.556660 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.556570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g" event={"ID":"c6961827-0898-4b29-b2d2-64f4e525d710","Type":"ContainerDied","Data":"995e24604402439f43c6df374041fbd30fa7c55bf46a01825150dd32756afb1c"}
Jul 31 22:28:52.558039 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.558016    2577 generic.go:356] "Generic (PLEG): container finished" podID="d6035ec9-e0c6-4041-8767-5de3a1d60d7d" containerID="c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903" exitCode=0
Jul 31 22:28:52.558146 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.558059    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"
Jul 31 22:28:52.558146 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.558108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn" event={"ID":"d6035ec9-e0c6-4041-8767-5de3a1d60d7d","Type":"ContainerDied","Data":"c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903"}
Jul 31 22:28:52.558287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.558158    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn" event={"ID":"d6035ec9-e0c6-4041-8767-5de3a1d60d7d","Type":"ContainerDied","Data":"4e368237b8e3393a35d4fc680f747a3ab96f76a5acd2e5b47c95ad565b358ebf"}
Jul 31 22:28:52.564983 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.564955    2577 scope.go:117] "RemoveContainer" containerID="f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12"
Jul 31 22:28:52.565257 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:28:52.565238    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12\": container with ID starting with f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12 not found: ID does not exist" containerID="f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12"
Jul 31 22:28:52.565340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.565262    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12"} err="failed to get container status \"f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12\": rpc error: code = NotFound desc = could not find container \"f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12\": container with ID starting with f4d45b49bbf77d519cc49c8459a78e6c34997772894194fae838c7a0dc565b12 not found: ID does not exist"
Jul 31 22:28:52.565340 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.565278    2577 scope.go:117] "RemoveContainer" containerID="bba87cb5799afa22e73bfa66695558f6c7a082bf0a586d6e0c51233edeefa116"
Jul 31 22:28:52.573656 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.573640    2577 scope.go:117] "RemoveContainer" containerID="c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903"
Jul 31 22:28:52.581356 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.581337    2577 scope.go:117] "RemoveContainer" containerID="c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903"
Jul 31 22:28:52.581593 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:28:52.581574    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903\": container with ID starting with c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903 not found: ID does not exist" containerID="c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903"
Jul 31 22:28:52.581655 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.581604    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903"} err="failed to get container status \"c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903\": rpc error: code = NotFound desc = could not find container \"c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903\": container with ID starting with c9b2bf9c0911d8a0d4269516d6a0ee55434bd699208841ff405ad40fa3863903 not found: ID does not exist"
Jul 31 22:28:52.606152 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.606125    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"]
Jul 31 22:28:52.610204 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.610167    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48fa749f-5ccbfc97fb-gdkkn"]
Jul 31 22:28:52.626389 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.626360    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"]
Jul 31 22:28:52.636625 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.636604    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-48fa749f-55d74d77b-72s4g"]
Jul 31 22:28:52.656116 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.656090    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"]
Jul 31 22:28:52.671433 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:52.671406    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48fa749f-85f96c5b74-jbfw6"]
Jul 31 22:28:54.532864 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:54.532831    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6961827-0898-4b29-b2d2-64f4e525d710" path="/var/lib/kubelet/pods/c6961827-0898-4b29-b2d2-64f4e525d710/volumes"
Jul 31 22:28:54.533295 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:54.533204    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6035ec9-e0c6-4041-8767-5de3a1d60d7d" path="/var/lib/kubelet/pods/d6035ec9-e0c6-4041-8767-5de3a1d60d7d/volumes"
Jul 31 22:28:54.533518 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:54.533506    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcaa5289-811a-45d3-a8b9-3af95e8f12d0" path="/var/lib/kubelet/pods/fcaa5289-811a-45d3-a8b9-3af95e8f12d0/volumes"
Jul 31 22:28:55.104224 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104193    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"]
Jul 31 22:28:55.104576 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104563    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6961827-0898-4b29-b2d2-64f4e525d710" containerName="maas-api"
Jul 31 22:28:55.104616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104577    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6961827-0898-4b29-b2d2-64f4e525d710" containerName="maas-api"
Jul 31 22:28:55.104616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104598    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6035ec9-e0c6-4041-8767-5de3a1d60d7d" containerName="payload-pre-processing"
Jul 31 22:28:55.104616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104605    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6035ec9-e0c6-4041-8767-5de3a1d60d7d" containerName="payload-pre-processing"
Jul 31 22:28:55.104709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104622    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcaa5289-811a-45d3-a8b9-3af95e8f12d0" containerName="payload-processing"
Jul 31 22:28:55.104709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104627    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcaa5289-811a-45d3-a8b9-3af95e8f12d0" containerName="payload-processing"
Jul 31 22:28:55.104709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104681    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6035ec9-e0c6-4041-8767-5de3a1d60d7d" containerName="payload-pre-processing"
Jul 31 22:28:55.104709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104689    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6961827-0898-4b29-b2d2-64f4e525d710" containerName="maas-api"
Jul 31 22:28:55.104709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.104698    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcaa5289-811a-45d3-a8b9-3af95e8f12d0" containerName="payload-processing"
Jul 31 22:28:55.109493 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.109473    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.112118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.112097    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-048b8d6f-serving-cert\""
Jul 31 22:28:55.122911 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.122884    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"]
Jul 31 22:28:55.217058 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.217017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxzz6\" (UniqueName: \"kubernetes.io/projected/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-kube-api-access-jxzz6\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.217263 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.217086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-openshift-service-ca\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.217263 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.217226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.318200 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.318138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.318407 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.318236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxzz6\" (UniqueName: \"kubernetes.io/projected/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-kube-api-access-jxzz6\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.318407 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.318275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-openshift-service-ca\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.318407 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:28:55.318346    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-serving-cert: secret "maas-api-e2e-migrate-048b8d6f-serving-cert" not found
Jul 31 22:28:55.318567 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:28:55.318463    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls podName:4caf4bfb-7a72-499e-bdbc-fa43ea28d38b nodeName:}" failed. No retries permitted until 2026-07-31 22:28:55.818436829 +0000 UTC m=+1727.771523049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls") pod "maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp" (UID: "4caf4bfb-7a72-499e-bdbc-fa43ea28d38b") : secret "maas-api-e2e-migrate-048b8d6f-serving-cert" not found
Jul 31 22:28:55.318912 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.318894    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-openshift-service-ca\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.326951 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.326933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxzz6\" (UniqueName: \"kubernetes.io/projected/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-kube-api-access-jxzz6\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.757224 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.757187    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"]
Jul 31 22:28:55.760945 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.760927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:55.763287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.763252    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-048b8d6f-dockercfg-xhbnx\""
Jul 31 22:28:55.763287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.763252    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-048b8d6f\""
Jul 31 22:28:55.770686 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.770659    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"]
Jul 31 22:28:55.789391 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.789356    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"]
Jul 31 22:28:55.797513 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.797490    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:55.806399 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.806376    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"]
Jul 31 22:28:55.824335 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.824307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/babea5da-2d8f-4a93-9372-fdadd4c14254-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688\" (UID: \"babea5da-2d8f-4a93-9372-fdadd4c14254\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:55.824492 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.824366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86qhl\" (UniqueName: \"kubernetes.io/projected/babea5da-2d8f-4a93-9372-fdadd4c14254-kube-api-access-86qhl\") pod \"payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688\" (UID: \"babea5da-2d8f-4a93-9372-fdadd4c14254\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:55.824492 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.824470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.826804 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.826777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls\") pod \"maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:55.925697 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.925653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655165ab-c729-4224-b4cc-eba67f37d45b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65\" (UID: \"655165ab-c729-4224-b4cc-eba67f37d45b\") " pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:55.925697 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.925690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjh8j\" (UniqueName: \"kubernetes.io/projected/655165ab-c729-4224-b4cc-eba67f37d45b-kube-api-access-vjh8j\") pod \"payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65\" (UID: \"655165ab-c729-4224-b4cc-eba67f37d45b\") " pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:55.925947 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.925718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/babea5da-2d8f-4a93-9372-fdadd4c14254-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688\" (UID: \"babea5da-2d8f-4a93-9372-fdadd4c14254\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:55.925947 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.925780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86qhl\" (UniqueName: \"kubernetes.io/projected/babea5da-2d8f-4a93-9372-fdadd4c14254-kube-api-access-86qhl\") pod \"payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688\" (UID: \"babea5da-2d8f-4a93-9372-fdadd4c14254\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:55.926423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.926400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/babea5da-2d8f-4a93-9372-fdadd4c14254-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688\" (UID: \"babea5da-2d8f-4a93-9372-fdadd4c14254\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:55.934112 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:55.934091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86qhl\" (UniqueName: \"kubernetes.io/projected/babea5da-2d8f-4a93-9372-fdadd4c14254-kube-api-access-86qhl\") pod \"payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688\" (UID: \"babea5da-2d8f-4a93-9372-fdadd4c14254\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:56.020458 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.020357    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:56.026816 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.026789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655165ab-c729-4224-b4cc-eba67f37d45b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65\" (UID: \"655165ab-c729-4224-b4cc-eba67f37d45b\") " pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:56.026949 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.026819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjh8j\" (UniqueName: \"kubernetes.io/projected/655165ab-c729-4224-b4cc-eba67f37d45b-kube-api-access-vjh8j\") pod \"payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65\" (UID: \"655165ab-c729-4224-b4cc-eba67f37d45b\") " pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:56.027529 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.027503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655165ab-c729-4224-b4cc-eba67f37d45b-plugins-config-volume\") pod \"payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65\" (UID: \"655165ab-c729-4224-b4cc-eba67f37d45b\") " pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:56.034803 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.034781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjh8j\" (UniqueName: \"kubernetes.io/projected/655165ab-c729-4224-b4cc-eba67f37d45b-kube-api-access-vjh8j\") pod \"payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65\" (UID: \"655165ab-c729-4224-b4cc-eba67f37d45b\") " pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:56.073004 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.072471    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:56.108463 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.108408    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:56.176621 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.176553    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"]
Jul 31 22:28:56.180944 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:28:56.180915    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4caf4bfb_7a72_499e_bdbc_fa43ea28d38b.slice/crio-a54d35f1a1e73c8da4d30857f082b78f7f404499bf3d3f7ec477a9498ffd4244 WatchSource:0}: Error finding container a54d35f1a1e73c8da4d30857f082b78f7f404499bf3d3f7ec477a9498ffd4244: Status 404 returned error can't find the container with id a54d35f1a1e73c8da4d30857f082b78f7f404499bf3d3f7ec477a9498ffd4244
Jul 31 22:28:56.238775 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.238746    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"]
Jul 31 22:28:56.240494 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:28:56.240463    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbabea5da_2d8f_4a93_9372_fdadd4c14254.slice/crio-51ea72ce39f37f35581503d306c192ccc458879ffd200b67d84f9cae259c8a71 WatchSource:0}: Error finding container 51ea72ce39f37f35581503d306c192ccc458879ffd200b67d84f9cae259c8a71: Status 404 returned error can't find the container with id 51ea72ce39f37f35581503d306c192ccc458879ffd200b67d84f9cae259c8a71
Jul 31 22:28:56.276639 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.276613    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"]
Jul 31 22:28:56.283448 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:28:56.283418    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655165ab_c729_4224_b4cc_eba67f37d45b.slice/crio-68514b1021b3cb07cf7ef941bf95d3db65dfcd15bee8af1bdb419d5ede459721 WatchSource:0}: Error finding container 68514b1021b3cb07cf7ef941bf95d3db65dfcd15bee8af1bdb419d5ede459721: Status 404 returned error can't find the container with id 68514b1021b3cb07cf7ef941bf95d3db65dfcd15bee8af1bdb419d5ede459721
Jul 31 22:28:56.590443 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.590405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65" event={"ID":"655165ab-c729-4224-b4cc-eba67f37d45b","Type":"ContainerStarted","Data":"816d83b7b016c649899b28f3c0b1b2f1c8d05495a5b2db6488de051e7c5a7481"}
Jul 31 22:28:56.590577 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.590478    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65" event={"ID":"655165ab-c729-4224-b4cc-eba67f37d45b","Type":"ContainerStarted","Data":"68514b1021b3cb07cf7ef941bf95d3db65dfcd15bee8af1bdb419d5ede459721"}
Jul 31 22:28:56.590577 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.590511    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:28:56.592206 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.592154    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp" event={"ID":"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b","Type":"ContainerStarted","Data":"a54d35f1a1e73c8da4d30857f082b78f7f404499bf3d3f7ec477a9498ffd4244"}
Jul 31 22:28:56.593779 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.593750    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688" event={"ID":"babea5da-2d8f-4a93-9372-fdadd4c14254","Type":"ContainerStarted","Data":"655e78737af0c83dc419f0bd73b4c44dedb24a70cb1b3723df9b8106030ae81f"}
Jul 31 22:28:56.593881 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.593791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688" event={"ID":"babea5da-2d8f-4a93-9372-fdadd4c14254","Type":"ContainerStarted","Data":"51ea72ce39f37f35581503d306c192ccc458879ffd200b67d84f9cae259c8a71"}
Jul 31 22:28:56.593881 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.593835    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:28:56.606069 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.605989    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65" podStartSLOduration=1.605971738 podStartE2EDuration="1.605971738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:28:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:28:56.605509361 +0000 UTC m=+1728.558595591" watchObservedRunningTime="2026-07-31 22:28:56.605971738 +0000 UTC m=+1728.559057967"
Jul 31 22:28:56.621565 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:56.621521    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688" podStartSLOduration=1.621507583 podStartE2EDuration="1.621507583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:28:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:28:56.618997383 +0000 UTC m=+1728.572083613" watchObservedRunningTime="2026-07-31 22:28:56.621507583 +0000 UTC m=+1728.574593811"
Jul 31 22:28:57.601644 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:57.601608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp" event={"ID":"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b","Type":"ContainerStarted","Data":"ab39dcc6c6e048cea6dfaf24886dbe593a1781f99ae5903e179ef80eef6640a3"}
Jul 31 22:28:57.602045 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:57.601714    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:28:57.629700 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:28:57.629646    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp" podStartSLOduration=2.286208479 podStartE2EDuration="2.629626895s" totalImagesPullingTime="343.418416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:28:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:28:57.627248632 +0000 UTC m=+1729.580334860" watchObservedRunningTime="2026-07-31 22:28:57.629626895 +0000 UTC m=+1729.582713123"
Jul 31 22:29:03.612870 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:03.612838    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:29:07.604271 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:07.604238    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:29:07.604630 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:07.604310    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:29:26.518764 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.518726    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"]
Jul 31 22:29:26.519406 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.518966    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp" podUID="4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" containerName="maas-api" containerID="cri-o://ab39dcc6c6e048cea6dfaf24886dbe593a1781f99ae5903e179ef80eef6640a3" gracePeriod=30
Jul 31 22:29:26.582054 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.582016    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"]
Jul 31 22:29:26.582320 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.582291    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65" podUID="655165ab-c729-4224-b4cc-eba67f37d45b" containerName="payload-processing" containerID="cri-o://816d83b7b016c649899b28f3c0b1b2f1c8d05495a5b2db6488de051e7c5a7481" gracePeriod=30
Jul 31 22:29:26.591573 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.591535    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"]
Jul 31 22:29:26.591808 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.591775    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688" podUID="babea5da-2d8f-4a93-9372-fdadd4c14254" containerName="payload-pre-processing" containerID="cri-o://655e78737af0c83dc419f0bd73b4c44dedb24a70cb1b3723df9b8106030ae81f" gracePeriod=30
Jul 31 22:29:26.773387 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.771439    2577 generic.go:356] "Generic (PLEG): container finished" podID="655165ab-c729-4224-b4cc-eba67f37d45b" containerID="816d83b7b016c649899b28f3c0b1b2f1c8d05495a5b2db6488de051e7c5a7481" exitCode=0
Jul 31 22:29:26.773387 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.771539    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65" event={"ID":"655165ab-c729-4224-b4cc-eba67f37d45b","Type":"ContainerDied","Data":"816d83b7b016c649899b28f3c0b1b2f1c8d05495a5b2db6488de051e7c5a7481"}
Jul 31 22:29:26.773937 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.773722    2577 generic.go:356] "Generic (PLEG): container finished" podID="4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" containerID="ab39dcc6c6e048cea6dfaf24886dbe593a1781f99ae5903e179ef80eef6640a3" exitCode=0
Jul 31 22:29:26.773937 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.773841    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp" event={"ID":"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b","Type":"ContainerDied","Data":"ab39dcc6c6e048cea6dfaf24886dbe593a1781f99ae5903e179ef80eef6640a3"}
Jul 31 22:29:26.776909 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.776881    2577 generic.go:356] "Generic (PLEG): container finished" podID="babea5da-2d8f-4a93-9372-fdadd4c14254" containerID="655e78737af0c83dc419f0bd73b4c44dedb24a70cb1b3723df9b8106030ae81f" exitCode=0
Jul 31 22:29:26.777041 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.777003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688" event={"ID":"babea5da-2d8f-4a93-9372-fdadd4c14254","Type":"ContainerDied","Data":"655e78737af0c83dc419f0bd73b4c44dedb24a70cb1b3723df9b8106030ae81f"}
Jul 31 22:29:26.867222 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.866726    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:29:26.909626 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.909554    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:29:26.911210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.910208    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-openshift-service-ca\") pod \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") "
Jul 31 22:29:26.911210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.910691    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls\") pod \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") "
Jul 31 22:29:26.911210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.910745    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" (UID: "4caf4bfb-7a72-499e-bdbc-fa43ea28d38b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:29:26.911210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.910757    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjh8j\" (UniqueName: \"kubernetes.io/projected/655165ab-c729-4224-b4cc-eba67f37d45b-kube-api-access-vjh8j\") pod \"655165ab-c729-4224-b4cc-eba67f37d45b\" (UID: \"655165ab-c729-4224-b4cc-eba67f37d45b\") "
Jul 31 22:29:26.911210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.910836    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655165ab-c729-4224-b4cc-eba67f37d45b-plugins-config-volume\") pod \"655165ab-c729-4224-b4cc-eba67f37d45b\" (UID: \"655165ab-c729-4224-b4cc-eba67f37d45b\") "
Jul 31 22:29:26.911210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.910905    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxzz6\" (UniqueName: \"kubernetes.io/projected/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-kube-api-access-jxzz6\") pod \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\" (UID: \"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b\") "
Jul 31 22:29:26.911210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.911206    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:29:26.911908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.911870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/655165ab-c729-4224-b4cc-eba67f37d45b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "655165ab-c729-4224-b4cc-eba67f37d45b" (UID: "655165ab-c729-4224-b4cc-eba67f37d45b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:29:26.913322 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.913306    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:29:26.913494 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.913475    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655165ab-c729-4224-b4cc-eba67f37d45b-kube-api-access-vjh8j" (OuterVolumeSpecName: "kube-api-access-vjh8j") pod "655165ab-c729-4224-b4cc-eba67f37d45b" (UID: "655165ab-c729-4224-b4cc-eba67f37d45b"). InnerVolumeSpecName "kube-api-access-vjh8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:26.915098 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.915073    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" (UID: "4caf4bfb-7a72-499e-bdbc-fa43ea28d38b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:29:26.915201 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:26.915104    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-kube-api-access-jxzz6" (OuterVolumeSpecName: "kube-api-access-jxzz6") pod "4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" (UID: "4caf4bfb-7a72-499e-bdbc-fa43ea28d38b"). InnerVolumeSpecName "kube-api-access-jxzz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:27.011592 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.011557    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/babea5da-2d8f-4a93-9372-fdadd4c14254-plugins-config-volume\") pod \"babea5da-2d8f-4a93-9372-fdadd4c14254\" (UID: \"babea5da-2d8f-4a93-9372-fdadd4c14254\") "
Jul 31 22:29:27.011783 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.011602    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86qhl\" (UniqueName: \"kubernetes.io/projected/babea5da-2d8f-4a93-9372-fdadd4c14254-kube-api-access-86qhl\") pod \"babea5da-2d8f-4a93-9372-fdadd4c14254\" (UID: \"babea5da-2d8f-4a93-9372-fdadd4c14254\") "
Jul 31 22:29:27.011944 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.011924    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:29:27.012015 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.011952    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjh8j\" (UniqueName: \"kubernetes.io/projected/655165ab-c729-4224-b4cc-eba67f37d45b-kube-api-access-vjh8j\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:29:27.012015 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.011969    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/655165ab-c729-4224-b4cc-eba67f37d45b-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:29:27.012015 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.011984    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxzz6\" (UniqueName: \"kubernetes.io/projected/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b-kube-api-access-jxzz6\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:29:27.012015 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.011990    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/babea5da-2d8f-4a93-9372-fdadd4c14254-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "babea5da-2d8f-4a93-9372-fdadd4c14254" (UID: "babea5da-2d8f-4a93-9372-fdadd4c14254"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:29:27.013650 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.013628    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/babea5da-2d8f-4a93-9372-fdadd4c14254-kube-api-access-86qhl" (OuterVolumeSpecName: "kube-api-access-86qhl") pod "babea5da-2d8f-4a93-9372-fdadd4c14254" (UID: "babea5da-2d8f-4a93-9372-fdadd4c14254"). InnerVolumeSpecName "kube-api-access-86qhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:29:27.113257 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.113228    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/babea5da-2d8f-4a93-9372-fdadd4c14254-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:29:27.113257 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.113254    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86qhl\" (UniqueName: \"kubernetes.io/projected/babea5da-2d8f-4a93-9372-fdadd4c14254-kube-api-access-86qhl\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:29:27.784765 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.784733    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"
Jul 31 22:29:27.784765 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.784743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65" event={"ID":"655165ab-c729-4224-b4cc-eba67f37d45b","Type":"ContainerDied","Data":"68514b1021b3cb07cf7ef941bf95d3db65dfcd15bee8af1bdb419d5ede459721"}
Jul 31 22:29:27.785352 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.784806    2577 scope.go:117] "RemoveContainer" containerID="816d83b7b016c649899b28f3c0b1b2f1c8d05495a5b2db6488de051e7c5a7481"
Jul 31 22:29:27.786252 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.786233    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"
Jul 31 22:29:27.786361 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.786267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp" event={"ID":"4caf4bfb-7a72-499e-bdbc-fa43ea28d38b","Type":"ContainerDied","Data":"a54d35f1a1e73c8da4d30857f082b78f7f404499bf3d3f7ec477a9498ffd4244"}
Jul 31 22:29:27.797736 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.797702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688" event={"ID":"babea5da-2d8f-4a93-9372-fdadd4c14254","Type":"ContainerDied","Data":"51ea72ce39f37f35581503d306c192ccc458879ffd200b67d84f9cae259c8a71"}
Jul 31 22:29:27.797951 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.797798    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"
Jul 31 22:29:27.801533 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.801257    2577 scope.go:117] "RemoveContainer" containerID="ab39dcc6c6e048cea6dfaf24886dbe593a1781f99ae5903e179ef80eef6640a3"
Jul 31 22:29:27.814126 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.814102    2577 scope.go:117] "RemoveContainer" containerID="655e78737af0c83dc419f0bd73b4c44dedb24a70cb1b3723df9b8106030ae81f"
Jul 31 22:29:27.822105 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.822078    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"]
Jul 31 22:29:27.824990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.824966    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-048b8d6f-9c98b6777-l2k65"]
Jul 31 22:29:27.835995 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.835971    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"]
Jul 31 22:29:27.841519 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.841495    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-048b8d6f-59b899449d-swxlp"]
Jul 31 22:29:27.851869 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.851845    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"]
Jul 31 22:29:27.859352 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:27.859332    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-048b8d6f-6fd84479b4-p2688"]
Jul 31 22:29:28.532556 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:28.532522    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" path="/var/lib/kubelet/pods/4caf4bfb-7a72-499e-bdbc-fa43ea28d38b/volumes"
Jul 31 22:29:28.532890 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:28.532876    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="655165ab-c729-4224-b4cc-eba67f37d45b" path="/var/lib/kubelet/pods/655165ab-c729-4224-b4cc-eba67f37d45b/volumes"
Jul 31 22:29:28.533269 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:28.533254    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="babea5da-2d8f-4a93-9372-fdadd4c14254" path="/var/lib/kubelet/pods/babea5da-2d8f-4a93-9372-fdadd4c14254/volumes"
Jul 31 22:29:31.204953 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.204915    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"]
Jul 31 22:29:31.205384 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205369    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" containerName="maas-api"
Jul 31 22:29:31.205429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205385    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" containerName="maas-api"
Jul 31 22:29:31.205429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205402    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655165ab-c729-4224-b4cc-eba67f37d45b" containerName="payload-processing"
Jul 31 22:29:31.205429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205408    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="655165ab-c729-4224-b4cc-eba67f37d45b" containerName="payload-processing"
Jul 31 22:29:31.205429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205424    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="babea5da-2d8f-4a93-9372-fdadd4c14254" containerName="payload-pre-processing"
Jul 31 22:29:31.205429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205430    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="babea5da-2d8f-4a93-9372-fdadd4c14254" containerName="payload-pre-processing"
Jul 31 22:29:31.205664 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205494    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="babea5da-2d8f-4a93-9372-fdadd4c14254" containerName="payload-pre-processing"
Jul 31 22:29:31.205664 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205504    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="655165ab-c729-4224-b4cc-eba67f37d45b" containerName="payload-processing"
Jul 31 22:29:31.205664 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.205510    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4caf4bfb-7a72-499e-bdbc-fa43ea28d38b" containerName="maas-api"
Jul 31 22:29:31.210028 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.210008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.212416 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.212394    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0efd1d71-serving-cert\""
Jul 31 22:29:31.219777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.219755    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"]
Jul 31 22:29:31.246507 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.246465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv6ph\" (UniqueName: \"kubernetes.io/projected/825a828e-e5fd-4d13-be2c-1f99e8c76b00-kube-api-access-gv6ph\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.246670 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.246530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/825a828e-e5fd-4d13-be2c-1f99e8c76b00-openshift-service-ca\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.246670 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.246557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/825a828e-e5fd-4d13-be2c-1f99e8c76b00-maas-api-tls\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.347498 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.347463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/825a828e-e5fd-4d13-be2c-1f99e8c76b00-openshift-service-ca\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.347677 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.347512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/825a828e-e5fd-4d13-be2c-1f99e8c76b00-maas-api-tls\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.347677 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.347590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv6ph\" (UniqueName: \"kubernetes.io/projected/825a828e-e5fd-4d13-be2c-1f99e8c76b00-kube-api-access-gv6ph\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.348108 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.348089    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/825a828e-e5fd-4d13-be2c-1f99e8c76b00-openshift-service-ca\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.349971 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.349949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/825a828e-e5fd-4d13-be2c-1f99e8c76b00-maas-api-tls\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.358130 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.358109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv6ph\" (UniqueName: \"kubernetes.io/projected/825a828e-e5fd-4d13-be2c-1f99e8c76b00-kube-api-access-gv6ph\") pod \"maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.522006 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.521909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:31.658331 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.658298    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"]
Jul 31 22:29:31.659604 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:29:31.659577    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825a828e_e5fd_4d13_be2c_1f99e8c76b00.slice/crio-ce1ea0cbd92eb36f1599f0ad3d14518db45fec9b5ab8cf6763970b91952979a7 WatchSource:0}: Error finding container ce1ea0cbd92eb36f1599f0ad3d14518db45fec9b5ab8cf6763970b91952979a7: Status 404 returned error can't find the container with id ce1ea0cbd92eb36f1599f0ad3d14518db45fec9b5ab8cf6763970b91952979a7
Jul 31 22:29:31.823691 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.823610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4" event={"ID":"825a828e-e5fd-4d13-be2c-1f99e8c76b00","Type":"ContainerStarted","Data":"ce1ea0cbd92eb36f1599f0ad3d14518db45fec9b5ab8cf6763970b91952979a7"}
Jul 31 22:29:31.832802 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.832770    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"]
Jul 31 22:29:31.837452 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.837437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:31.840101 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.840080    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0efd1d71\""
Jul 31 22:29:31.840245 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.840141    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0efd1d71-dockercfg-mck2l\""
Jul 31 22:29:31.844891 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.844871    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"]
Jul 31 22:29:31.852302 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.852273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brcc6\" (UniqueName: \"kubernetes.io/projected/ef235bd1-8443-47d7-ab91-3bef547a0a61-kube-api-access-brcc6\") pod \"payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg\" (UID: \"ef235bd1-8443-47d7-ab91-3bef547a0a61\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:31.852434 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.852354    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef235bd1-8443-47d7-ab91-3bef547a0a61-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg\" (UID: \"ef235bd1-8443-47d7-ab91-3bef547a0a61\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:31.877656 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.877627    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"]
Jul 31 22:29:31.885806 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.885778    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:31.891900 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.891873    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"]
Jul 31 22:29:31.953411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.953378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef235bd1-8443-47d7-ab91-3bef547a0a61-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg\" (UID: \"ef235bd1-8443-47d7-ab91-3bef547a0a61\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:31.953611 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.953442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tff5\" (UniqueName: \"kubernetes.io/projected/f0b9753e-431c-4065-84eb-fde95dc69391-kube-api-access-5tff5\") pod \"payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7\" (UID: \"f0b9753e-431c-4065-84eb-fde95dc69391\") " pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:31.953611 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.953506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b9753e-431c-4065-84eb-fde95dc69391-plugins-config-volume\") pod \"payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7\" (UID: \"f0b9753e-431c-4065-84eb-fde95dc69391\") " pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:31.953887 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.953605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brcc6\" (UniqueName: \"kubernetes.io/projected/ef235bd1-8443-47d7-ab91-3bef547a0a61-kube-api-access-brcc6\") pod \"payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg\" (UID: \"ef235bd1-8443-47d7-ab91-3bef547a0a61\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:31.954508 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.954482    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef235bd1-8443-47d7-ab91-3bef547a0a61-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg\" (UID: \"ef235bd1-8443-47d7-ab91-3bef547a0a61\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:31.961470 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:31.961447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brcc6\" (UniqueName: \"kubernetes.io/projected/ef235bd1-8443-47d7-ab91-3bef547a0a61-kube-api-access-brcc6\") pod \"payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg\" (UID: \"ef235bd1-8443-47d7-ab91-3bef547a0a61\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:32.054960 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.054933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tff5\" (UniqueName: \"kubernetes.io/projected/f0b9753e-431c-4065-84eb-fde95dc69391-kube-api-access-5tff5\") pod \"payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7\" (UID: \"f0b9753e-431c-4065-84eb-fde95dc69391\") " pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:32.055089 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.054996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b9753e-431c-4065-84eb-fde95dc69391-plugins-config-volume\") pod \"payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7\" (UID: \"f0b9753e-431c-4065-84eb-fde95dc69391\") " pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:32.055661 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.055636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b9753e-431c-4065-84eb-fde95dc69391-plugins-config-volume\") pod \"payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7\" (UID: \"f0b9753e-431c-4065-84eb-fde95dc69391\") " pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:32.062638 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.062613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tff5\" (UniqueName: \"kubernetes.io/projected/f0b9753e-431c-4065-84eb-fde95dc69391-kube-api-access-5tff5\") pod \"payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7\" (UID: \"f0b9753e-431c-4065-84eb-fde95dc69391\") " pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:32.149505 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.149473    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:32.198438 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.198404    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:32.301258 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.300902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"]
Jul 31 22:29:32.303730 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:29:32.303698    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef235bd1_8443_47d7_ab91_3bef547a0a61.slice/crio-fdf5c05edcfe61639dcb11bdb7d1d216737a57c4bee11a4c7f7fc859806b2cbf WatchSource:0}: Error finding container fdf5c05edcfe61639dcb11bdb7d1d216737a57c4bee11a4c7f7fc859806b2cbf: Status 404 returned error can't find the container with id fdf5c05edcfe61639dcb11bdb7d1d216737a57c4bee11a4c7f7fc859806b2cbf
Jul 31 22:29:32.350968 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.350935    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"]
Jul 31 22:29:32.354629 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:29:32.354598    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b9753e_431c_4065_84eb_fde95dc69391.slice/crio-b4324f5f79fb08a98b85b81f8dc2d663312309960c13163825b7783d3895ecc1 WatchSource:0}: Error finding container b4324f5f79fb08a98b85b81f8dc2d663312309960c13163825b7783d3895ecc1: Status 404 returned error can't find the container with id b4324f5f79fb08a98b85b81f8dc2d663312309960c13163825b7783d3895ecc1
Jul 31 22:29:32.831641 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.831610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7" event={"ID":"f0b9753e-431c-4065-84eb-fde95dc69391","Type":"ContainerStarted","Data":"114c61b066424970cbf886fc26a8e2f178d76da50331707f6a62196418c8e7e2"}
Jul 31 22:29:32.831818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.831660    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7" event={"ID":"f0b9753e-431c-4065-84eb-fde95dc69391","Type":"ContainerStarted","Data":"b4324f5f79fb08a98b85b81f8dc2d663312309960c13163825b7783d3895ecc1"}
Jul 31 22:29:32.831818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.831699    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:32.833308 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.833282    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg" event={"ID":"ef235bd1-8443-47d7-ab91-3bef547a0a61","Type":"ContainerStarted","Data":"fdec41d06e46954d1ed66f3373efb24bfbd3601bd722710a3f902b3ef3d072d0"}
Jul 31 22:29:32.833447 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.833323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg" event={"ID":"ef235bd1-8443-47d7-ab91-3bef547a0a61","Type":"ContainerStarted","Data":"fdf5c05edcfe61639dcb11bdb7d1d216737a57c4bee11a4c7f7fc859806b2cbf"}
Jul 31 22:29:32.833447 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.833377    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:29:32.834925 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.834900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4" event={"ID":"825a828e-e5fd-4d13-be2c-1f99e8c76b00","Type":"ContainerStarted","Data":"8dafc210e96cd393c464c90e77cc0a1d7c16527bf0aa6671a53c7e07f492df73"}
Jul 31 22:29:32.835071 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.834978    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:32.846576 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.846527    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7" podStartSLOduration=1.84650991 podStartE2EDuration="1.84650991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:29:32.845735727 +0000 UTC m=+1764.798821992" watchObservedRunningTime="2026-07-31 22:29:32.84650991 +0000 UTC m=+1764.799596142"
Jul 31 22:29:32.863021 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.862963    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg" podStartSLOduration=1.862942257 podStartE2EDuration="1.862942257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:29:32.860049886 +0000 UTC m=+1764.813136119" watchObservedRunningTime="2026-07-31 22:29:32.862942257 +0000 UTC m=+1764.816028487"
Jul 31 22:29:32.877338 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:32.877282    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4" podStartSLOduration=1.510775081 podStartE2EDuration="1.877264788s" totalImagesPullingTime="366.489707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:29:32.876167996 +0000 UTC m=+1764.829254233" watchObservedRunningTime="2026-07-31 22:29:32.877264788 +0000 UTC m=+1764.830351017"
Jul 31 22:29:38.846133 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:38.846104    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:29:43.842416 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:43.842380    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:29:43.842952 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:29:43.842729    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:30:01.692859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:01.692760    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"]
Jul 31 22:30:01.693486 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:01.692979    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4" podUID="825a828e-e5fd-4d13-be2c-1f99e8c76b00" containerName="maas-api" containerID="cri-o://8dafc210e96cd393c464c90e77cc0a1d7c16527bf0aa6671a53c7e07f492df73" gracePeriod=30
Jul 31 22:30:01.757425 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:01.757391    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"]
Jul 31 22:30:01.757652 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:01.757605    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7" podUID="f0b9753e-431c-4065-84eb-fde95dc69391" containerName="payload-processing" containerID="cri-o://114c61b066424970cbf886fc26a8e2f178d76da50331707f6a62196418c8e7e2" gracePeriod=30
Jul 31 22:30:01.767762 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:01.767722    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"]
Jul 31 22:30:01.768116 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:01.768046    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg" podUID="ef235bd1-8443-47d7-ab91-3bef547a0a61" containerName="payload-pre-processing" containerID="cri-o://fdec41d06e46954d1ed66f3373efb24bfbd3601bd722710a3f902b3ef3d072d0" gracePeriod=30
Jul 31 22:30:02.009611 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.009572    2577 generic.go:356] "Generic (PLEG): container finished" podID="f0b9753e-431c-4065-84eb-fde95dc69391" containerID="114c61b066424970cbf886fc26a8e2f178d76da50331707f6a62196418c8e7e2" exitCode=0
Jul 31 22:30:02.009790 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.009686    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7" event={"ID":"f0b9753e-431c-4065-84eb-fde95dc69391","Type":"ContainerDied","Data":"114c61b066424970cbf886fc26a8e2f178d76da50331707f6a62196418c8e7e2"}
Jul 31 22:30:02.011845 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.011784    2577 generic.go:356] "Generic (PLEG): container finished" podID="ef235bd1-8443-47d7-ab91-3bef547a0a61" containerID="fdec41d06e46954d1ed66f3373efb24bfbd3601bd722710a3f902b3ef3d072d0" exitCode=0
Jul 31 22:30:02.012001 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.011893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg" event={"ID":"ef235bd1-8443-47d7-ab91-3bef547a0a61","Type":"ContainerDied","Data":"fdec41d06e46954d1ed66f3373efb24bfbd3601bd722710a3f902b3ef3d072d0"}
Jul 31 22:30:02.013724 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.013697    2577 generic.go:356] "Generic (PLEG): container finished" podID="825a828e-e5fd-4d13-be2c-1f99e8c76b00" containerID="8dafc210e96cd393c464c90e77cc0a1d7c16527bf0aa6671a53c7e07f492df73" exitCode=0
Jul 31 22:30:02.013871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.013751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4" event={"ID":"825a828e-e5fd-4d13-be2c-1f99e8c76b00","Type":"ContainerDied","Data":"8dafc210e96cd393c464c90e77cc0a1d7c16527bf0aa6671a53c7e07f492df73"}
Jul 31 22:30:02.053960 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.053934    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:30:02.062623 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.062592    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:30:02.072849 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.072822    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:30:02.142414 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.142377    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tff5\" (UniqueName: \"kubernetes.io/projected/f0b9753e-431c-4065-84eb-fde95dc69391-kube-api-access-5tff5\") pod \"f0b9753e-431c-4065-84eb-fde95dc69391\" (UID: \"f0b9753e-431c-4065-84eb-fde95dc69391\") "
Jul 31 22:30:02.142598 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.142504    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b9753e-431c-4065-84eb-fde95dc69391-plugins-config-volume\") pod \"f0b9753e-431c-4065-84eb-fde95dc69391\" (UID: \"f0b9753e-431c-4065-84eb-fde95dc69391\") "
Jul 31 22:30:02.142877 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.142850    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0b9753e-431c-4065-84eb-fde95dc69391-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0b9753e-431c-4065-84eb-fde95dc69391" (UID: "f0b9753e-431c-4065-84eb-fde95dc69391"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:30:02.144511 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.144486    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b9753e-431c-4065-84eb-fde95dc69391-kube-api-access-5tff5" (OuterVolumeSpecName: "kube-api-access-5tff5") pod "f0b9753e-431c-4065-84eb-fde95dc69391" (UID: "f0b9753e-431c-4065-84eb-fde95dc69391"). InnerVolumeSpecName "kube-api-access-5tff5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:30:02.243812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.243725    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/825a828e-e5fd-4d13-be2c-1f99e8c76b00-maas-api-tls\") pod \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") "
Jul 31 22:30:02.243812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.243792    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv6ph\" (UniqueName: \"kubernetes.io/projected/825a828e-e5fd-4d13-be2c-1f99e8c76b00-kube-api-access-gv6ph\") pod \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") "
Jul 31 22:30:02.243987 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.243839    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/825a828e-e5fd-4d13-be2c-1f99e8c76b00-openshift-service-ca\") pod \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\" (UID: \"825a828e-e5fd-4d13-be2c-1f99e8c76b00\") "
Jul 31 22:30:02.243987 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.243864    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef235bd1-8443-47d7-ab91-3bef547a0a61-plugins-config-volume\") pod \"ef235bd1-8443-47d7-ab91-3bef547a0a61\" (UID: \"ef235bd1-8443-47d7-ab91-3bef547a0a61\") "
Jul 31 22:30:02.243987 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.243895    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brcc6\" (UniqueName: \"kubernetes.io/projected/ef235bd1-8443-47d7-ab91-3bef547a0a61-kube-api-access-brcc6\") pod \"ef235bd1-8443-47d7-ab91-3bef547a0a61\" (UID: \"ef235bd1-8443-47d7-ab91-3bef547a0a61\") "
Jul 31 22:30:02.244160 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.244141    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tff5\" (UniqueName: \"kubernetes.io/projected/f0b9753e-431c-4065-84eb-fde95dc69391-kube-api-access-5tff5\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:02.244292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.244166    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0b9753e-431c-4065-84eb-fde95dc69391-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:02.244292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.244269    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/825a828e-e5fd-4d13-be2c-1f99e8c76b00-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "825a828e-e5fd-4d13-be2c-1f99e8c76b00" (UID: "825a828e-e5fd-4d13-be2c-1f99e8c76b00"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:30:02.244391 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.244287    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef235bd1-8443-47d7-ab91-3bef547a0a61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef235bd1-8443-47d7-ab91-3bef547a0a61" (UID: "ef235bd1-8443-47d7-ab91-3bef547a0a61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:30:02.246089 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.246063    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825a828e-e5fd-4d13-be2c-1f99e8c76b00-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "825a828e-e5fd-4d13-be2c-1f99e8c76b00" (UID: "825a828e-e5fd-4d13-be2c-1f99e8c76b00"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:30:02.246230 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.246106    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef235bd1-8443-47d7-ab91-3bef547a0a61-kube-api-access-brcc6" (OuterVolumeSpecName: "kube-api-access-brcc6") pod "ef235bd1-8443-47d7-ab91-3bef547a0a61" (UID: "ef235bd1-8443-47d7-ab91-3bef547a0a61"). InnerVolumeSpecName "kube-api-access-brcc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:30:02.246230 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.246131    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825a828e-e5fd-4d13-be2c-1f99e8c76b00-kube-api-access-gv6ph" (OuterVolumeSpecName: "kube-api-access-gv6ph") pod "825a828e-e5fd-4d13-be2c-1f99e8c76b00" (UID: "825a828e-e5fd-4d13-be2c-1f99e8c76b00"). InnerVolumeSpecName "kube-api-access-gv6ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:30:02.345606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.345568    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/825a828e-e5fd-4d13-be2c-1f99e8c76b00-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:02.345606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.345600    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef235bd1-8443-47d7-ab91-3bef547a0a61-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:02.345606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.345610    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brcc6\" (UniqueName: \"kubernetes.io/projected/ef235bd1-8443-47d7-ab91-3bef547a0a61-kube-api-access-brcc6\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:02.345852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.345621    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/825a828e-e5fd-4d13-be2c-1f99e8c76b00-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:02.345852 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:02.345632    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv6ph\" (UniqueName: \"kubernetes.io/projected/825a828e-e5fd-4d13-be2c-1f99e8c76b00-kube-api-access-gv6ph\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:03.019754 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.019723    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"
Jul 31 22:30:03.020259 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.019758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4" event={"ID":"825a828e-e5fd-4d13-be2c-1f99e8c76b00","Type":"ContainerDied","Data":"ce1ea0cbd92eb36f1599f0ad3d14518db45fec9b5ab8cf6763970b91952979a7"}
Jul 31 22:30:03.020259 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.019820    2577 scope.go:117] "RemoveContainer" containerID="8dafc210e96cd393c464c90e77cc0a1d7c16527bf0aa6671a53c7e07f492df73"
Jul 31 22:30:03.021264 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.021247    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"
Jul 31 22:30:03.021351 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.021241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7" event={"ID":"f0b9753e-431c-4065-84eb-fde95dc69391","Type":"ContainerDied","Data":"b4324f5f79fb08a98b85b81f8dc2d663312309960c13163825b7783d3895ecc1"}
Jul 31 22:30:03.022654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.022633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg" event={"ID":"ef235bd1-8443-47d7-ab91-3bef547a0a61","Type":"ContainerDied","Data":"fdf5c05edcfe61639dcb11bdb7d1d216737a57c4bee11a4c7f7fc859806b2cbf"}
Jul 31 22:30:03.022654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.022647    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"
Jul 31 22:30:03.029679 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.029662    2577 scope.go:117] "RemoveContainer" containerID="114c61b066424970cbf886fc26a8e2f178d76da50331707f6a62196418c8e7e2"
Jul 31 22:30:03.038319 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.038299    2577 scope.go:117] "RemoveContainer" containerID="fdec41d06e46954d1ed66f3373efb24bfbd3601bd722710a3f902b3ef3d072d0"
Jul 31 22:30:03.043460 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.043429    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"]
Jul 31 22:30:03.047402 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.047377    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0efd1d71-5d99844ffc-k6nl4"]
Jul 31 22:30:03.057626 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.057499    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"]
Jul 31 22:30:03.060871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.060844    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0efd1d71-7b4b7c7f44-pczx7"]
Jul 31 22:30:03.075960 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.075924    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"]
Jul 31 22:30:03.081419 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:03.081381    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0efd1d71-5d786b5456-m98kg"]
Jul 31 22:30:04.534043 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:04.534010    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="825a828e-e5fd-4d13-be2c-1f99e8c76b00" path="/var/lib/kubelet/pods/825a828e-e5fd-4d13-be2c-1f99e8c76b00/volumes"
Jul 31 22:30:04.534468 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:04.534401    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef235bd1-8443-47d7-ab91-3bef547a0a61" path="/var/lib/kubelet/pods/ef235bd1-8443-47d7-ab91-3bef547a0a61/volumes"
Jul 31 22:30:04.534709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:04.534697    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0b9753e-431c-4065-84eb-fde95dc69391" path="/var/lib/kubelet/pods/f0b9753e-431c-4065-84eb-fde95dc69391/volumes"
Jul 31 22:30:07.522231 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522194    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"]
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522680    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b9753e-431c-4065-84eb-fde95dc69391" containerName="payload-processing"
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522695    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b9753e-431c-4065-84eb-fde95dc69391" containerName="payload-processing"
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522709    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825a828e-e5fd-4d13-be2c-1f99e8c76b00" containerName="maas-api"
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522715    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="825a828e-e5fd-4d13-be2c-1f99e8c76b00" containerName="maas-api"
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522729    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef235bd1-8443-47d7-ab91-3bef547a0a61" containerName="payload-pre-processing"
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522738    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef235bd1-8443-47d7-ab91-3bef547a0a61" containerName="payload-pre-processing"
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522817    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef235bd1-8443-47d7-ab91-3bef547a0a61" containerName="payload-pre-processing"
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522831    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="825a828e-e5fd-4d13-be2c-1f99e8c76b00" containerName="maas-api"
Jul 31 22:30:07.522874 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.522841    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0b9753e-431c-4065-84eb-fde95dc69391" containerName="payload-processing"
Jul 31 22:30:07.525988 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.525971    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:07.528477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.528452    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-a6187704-serving-cert\""
Jul 31 22:30:07.537806 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.537777    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"]
Jul 31 22:30:07.596123 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.596084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:07.596123 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.596121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwpzk\" (UniqueName: \"kubernetes.io/projected/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-kube-api-access-nwpzk\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:07.596397 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.596211    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-openshift-service-ca\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:07.697007 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.696970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:07.697007 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.697011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwpzk\" (UniqueName: \"kubernetes.io/projected/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-kube-api-access-nwpzk\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:07.697273 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.697054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-openshift-service-ca\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:07.697273 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:30:07.697132    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-serving-cert: secret "maas-api-e2e-derive-a6187704-serving-cert" not found
Jul 31 22:30:07.697273 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:30:07.697236    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls podName:0c39a4d0-f7e2-41b2-b355-965a389f0ea6 nodeName:}" failed. No retries permitted until 2026-07-31 22:30:08.197217693 +0000 UTC m=+1800.150303901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls") pod "maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2" (UID: "0c39a4d0-f7e2-41b2-b355-965a389f0ea6") : secret "maas-api-e2e-derive-a6187704-serving-cert" not found
Jul 31 22:30:07.697758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.697738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-openshift-service-ca\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:07.706235 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:07.706171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwpzk\" (UniqueName: \"kubernetes.io/projected/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-kube-api-access-nwpzk\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:08.122760 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.122722    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"]
Jul 31 22:30:08.126595 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.126578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:08.128938 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.128914    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a6187704\""
Jul 31 22:30:08.129057 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.128914    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a6187704-dockercfg-phnwj\""
Jul 31 22:30:08.136379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.136354    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"]
Jul 31 22:30:08.158748 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.158715    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"]
Jul 31 22:30:08.162416 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.162395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:08.173411 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.173381    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"]
Jul 31 22:30:08.201473 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.201440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-plugins-config-volume\") pod \"payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv\" (UID: \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\") " pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:08.201640 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.201500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bls4x\" (UniqueName: \"kubernetes.io/projected/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-kube-api-access-bls4x\") pod \"payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv\" (UID: \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\") " pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:08.201640 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.201565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzgmx\" (UniqueName: \"kubernetes.io/projected/9f8d0938-5f1e-4883-b30a-c935e25cbde6-kube-api-access-jzgmx\") pod \"payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4\" (UID: \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:08.201640 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.201599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:08.201640 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.201617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8d0938-5f1e-4883-b30a-c935e25cbde6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4\" (UID: \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:08.203937 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.203910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls\") pod \"maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:08.302433 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.302377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzgmx\" (UniqueName: \"kubernetes.io/projected/9f8d0938-5f1e-4883-b30a-c935e25cbde6-kube-api-access-jzgmx\") pod \"payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4\" (UID: \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:08.302433 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.302433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8d0938-5f1e-4883-b30a-c935e25cbde6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4\" (UID: \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:08.302713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.302478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-plugins-config-volume\") pod \"payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv\" (UID: \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\") " pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:08.302713 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.302518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bls4x\" (UniqueName: \"kubernetes.io/projected/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-kube-api-access-bls4x\") pod \"payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv\" (UID: \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\") " pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:08.303201 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.303160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-plugins-config-volume\") pod \"payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv\" (UID: \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\") " pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:08.303259 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.303241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8d0938-5f1e-4883-b30a-c935e25cbde6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4\" (UID: \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:08.310238 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.310209    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzgmx\" (UniqueName: \"kubernetes.io/projected/9f8d0938-5f1e-4883-b30a-c935e25cbde6-kube-api-access-jzgmx\") pod \"payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4\" (UID: \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:08.310393 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.310320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bls4x\" (UniqueName: \"kubernetes.io/projected/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-kube-api-access-bls4x\") pod \"payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv\" (UID: \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\") " pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:08.438803 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.438724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:08.441936 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.441917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a6187704-dockercfg-phnwj\""
Jul 31 22:30:08.450276 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.450252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:08.474100 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.474071    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:08.603093 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.603062    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"]
Jul 31 22:30:08.605313 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:30:08.605005    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c39a4d0_f7e2_41b2_b355_965a389f0ea6.slice/crio-5b56f4963250a1bf2c56465a56127bf27e0c458bb40303ef88a811a675add19d WatchSource:0}: Error finding container 5b56f4963250a1bf2c56465a56127bf27e0c458bb40303ef88a811a675add19d: Status 404 returned error can't find the container with id 5b56f4963250a1bf2c56465a56127bf27e0c458bb40303ef88a811a675add19d
Jul 31 22:30:08.635356 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.635323    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"]
Jul 31 22:30:08.636574 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:30:08.636551    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8d0938_5f1e_4883_b30a_c935e25cbde6.slice/crio-3bd00095d6a450804f1c967bef5fb8e4657a7c2f0168992e10741dd0c0fa45fd WatchSource:0}: Error finding container 3bd00095d6a450804f1c967bef5fb8e4657a7c2f0168992e10741dd0c0fa45fd: Status 404 returned error can't find the container with id 3bd00095d6a450804f1c967bef5fb8e4657a7c2f0168992e10741dd0c0fa45fd
Jul 31 22:30:08.670739 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:08.670713    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"]
Jul 31 22:30:08.673461 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:30:08.673429    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0a269f_6f1a_4b58_b9ff_f93e9a46e77f.slice/crio-5b56b5041d71d8ddb5cbd8ee0b0bd518cbbc0e48d5fd2906d6922af23a3a16f5 WatchSource:0}: Error finding container 5b56b5041d71d8ddb5cbd8ee0b0bd518cbbc0e48d5fd2906d6922af23a3a16f5: Status 404 returned error can't find the container with id 5b56b5041d71d8ddb5cbd8ee0b0bd518cbbc0e48d5fd2906d6922af23a3a16f5
Jul 31 22:30:09.072811 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.072772    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4" event={"ID":"9f8d0938-5f1e-4883-b30a-c935e25cbde6","Type":"ContainerStarted","Data":"10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f"}
Jul 31 22:30:09.072996 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.072853    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4" event={"ID":"9f8d0938-5f1e-4883-b30a-c935e25cbde6","Type":"ContainerStarted","Data":"3bd00095d6a450804f1c967bef5fb8e4657a7c2f0168992e10741dd0c0fa45fd"}
Jul 31 22:30:09.072996 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.072884    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:09.074503 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.074479    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv" event={"ID":"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f","Type":"ContainerStarted","Data":"a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28"}
Jul 31 22:30:09.074644 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.074523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv" event={"ID":"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f","Type":"ContainerStarted","Data":"5b56b5041d71d8ddb5cbd8ee0b0bd518cbbc0e48d5fd2906d6922af23a3a16f5"}
Jul 31 22:30:09.074644 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.074553    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:09.076126 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.076102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2" event={"ID":"0c39a4d0-f7e2-41b2-b355-965a389f0ea6","Type":"ContainerStarted","Data":"1c26271c031a4481f1295c45437dd1545d4889e7bc935790fed07bd446fdb76b"}
Jul 31 22:30:09.076314 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.076145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2" event={"ID":"0c39a4d0-f7e2-41b2-b355-965a389f0ea6","Type":"ContainerStarted","Data":"5b56f4963250a1bf2c56465a56127bf27e0c458bb40303ef88a811a675add19d"}
Jul 31 22:30:09.076314 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.076212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:09.086985 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.086930    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4" podStartSLOduration=1.086913058 podStartE2EDuration="1.086913058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:09.086876795 +0000 UTC m=+1801.039963026" watchObservedRunningTime="2026-07-31 22:30:09.086913058 +0000 UTC m=+1801.039999280"
Jul 31 22:30:09.105165 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.105117    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2" podStartSLOduration=1.7331199590000002 podStartE2EDuration="2.105101936s" totalImagesPullingTime="371.981977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:09.103635249 +0000 UTC m=+1801.056721489" watchObservedRunningTime="2026-07-31 22:30:09.105101936 +0000 UTC m=+1801.058188239"
Jul 31 22:30:09.119814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:09.119767    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv" podStartSLOduration=1.119752245 podStartE2EDuration="1.119752245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:09.118787447 +0000 UTC m=+1801.071873673" watchObservedRunningTime="2026-07-31 22:30:09.119752245 +0000 UTC m=+1801.072838474"
Jul 31 22:30:15.087793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:15.087761    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:20.084043 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:20.084010    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:20.084629 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:20.084098    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:38.097697 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.097660    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"]
Jul 31 22:30:38.098491 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.098457    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2" podUID="0c39a4d0-f7e2-41b2-b355-965a389f0ea6" containerName="maas-api" containerID="cri-o://1c26271c031a4481f1295c45437dd1545d4889e7bc935790fed07bd446fdb76b" gracePeriod=30
Jul 31 22:30:38.150108 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.150071    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"]
Jul 31 22:30:38.150395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.150343    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv" podUID="9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f" containerName="payload-processing" containerID="cri-o://a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28" gracePeriod=30
Jul 31 22:30:38.173508 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.173471    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"]
Jul 31 22:30:38.174285 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.174246    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4" podUID="9f8d0938-5f1e-4883-b30a-c935e25cbde6" containerName="payload-pre-processing" containerID="cri-o://10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f" gracePeriod=30
Jul 31 22:30:38.246158 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.246097    2577 generic.go:356] "Generic (PLEG): container finished" podID="0c39a4d0-f7e2-41b2-b355-965a389f0ea6" containerID="1c26271c031a4481f1295c45437dd1545d4889e7bc935790fed07bd446fdb76b" exitCode=0
Jul 31 22:30:38.246359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.246223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2" event={"ID":"0c39a4d0-f7e2-41b2-b355-965a389f0ea6","Type":"ContainerDied","Data":"1c26271c031a4481f1295c45437dd1545d4889e7bc935790fed07bd446fdb76b"}
Jul 31 22:30:38.451565 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.451533    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:38.510742 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.510720    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:38.516750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.516733    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:38.577830 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.577797    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-plugins-config-volume\") pod \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\" (UID: \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\") "
Jul 31 22:30:38.578001 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.577836    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls\") pod \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") "
Jul 31 22:30:38.578001 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.577870    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzgmx\" (UniqueName: \"kubernetes.io/projected/9f8d0938-5f1e-4883-b30a-c935e25cbde6-kube-api-access-jzgmx\") pod \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\" (UID: \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\") "
Jul 31 22:30:38.578001 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.577939    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwpzk\" (UniqueName: \"kubernetes.io/projected/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-kube-api-access-nwpzk\") pod \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") "
Jul 31 22:30:38.578001 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.577963    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-openshift-service-ca\") pod \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\" (UID: \"0c39a4d0-f7e2-41b2-b355-965a389f0ea6\") "
Jul 31 22:30:38.578001 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.577995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bls4x\" (UniqueName: \"kubernetes.io/projected/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-kube-api-access-bls4x\") pod \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\" (UID: \"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f\") "
Jul 31 22:30:38.578304 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.578076    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8d0938-5f1e-4883-b30a-c935e25cbde6-plugins-config-volume\") pod \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\" (UID: \"9f8d0938-5f1e-4883-b30a-c935e25cbde6\") "
Jul 31 22:30:38.578304 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.578270    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f" (UID: "9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:30:38.578433 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.578370    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c39a4d0-f7e2-41b2-b355-965a389f0ea6" (UID: "0c39a4d0-f7e2-41b2-b355-965a389f0ea6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:30:38.578584 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.578529    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:38.578584 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.578556    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:38.578584 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.578572    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8d0938-5f1e-4883-b30a-c935e25cbde6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f8d0938-5f1e-4883-b30a-c935e25cbde6" (UID: "9f8d0938-5f1e-4883-b30a-c935e25cbde6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:30:38.580151 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.580126    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-kube-api-access-nwpzk" (OuterVolumeSpecName: "kube-api-access-nwpzk") pod "0c39a4d0-f7e2-41b2-b355-965a389f0ea6" (UID: "0c39a4d0-f7e2-41b2-b355-965a389f0ea6"). InnerVolumeSpecName "kube-api-access-nwpzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:30:38.580313 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.580158    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c39a4d0-f7e2-41b2-b355-965a389f0ea6" (UID: "0c39a4d0-f7e2-41b2-b355-965a389f0ea6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:30:38.580435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.580419    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8d0938-5f1e-4883-b30a-c935e25cbde6-kube-api-access-jzgmx" (OuterVolumeSpecName: "kube-api-access-jzgmx") pod "9f8d0938-5f1e-4883-b30a-c935e25cbde6" (UID: "9f8d0938-5f1e-4883-b30a-c935e25cbde6"). InnerVolumeSpecName "kube-api-access-jzgmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:30:38.580619 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.580589    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-kube-api-access-bls4x" (OuterVolumeSpecName: "kube-api-access-bls4x") pod "9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f" (UID: "9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f"). InnerVolumeSpecName "kube-api-access-bls4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:30:38.680028 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.679920    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwpzk\" (UniqueName: \"kubernetes.io/projected/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-kube-api-access-nwpzk\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:38.680028 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.679956    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bls4x\" (UniqueName: \"kubernetes.io/projected/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f-kube-api-access-bls4x\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:38.680028 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.679972    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f8d0938-5f1e-4883-b30a-c935e25cbde6-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:38.680028 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.679987    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c39a4d0-f7e2-41b2-b355-965a389f0ea6-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:38.680028 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:38.680001    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzgmx\" (UniqueName: \"kubernetes.io/projected/9f8d0938-5f1e-4883-b30a-c935e25cbde6-kube-api-access-jzgmx\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:30:39.252911 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.252874    2577 generic.go:356] "Generic (PLEG): container finished" podID="9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f" containerID="a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28" exitCode=0
Jul 31 22:30:39.253420 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.252930    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"
Jul 31 22:30:39.253420 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.252976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv" event={"ID":"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f","Type":"ContainerDied","Data":"a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28"}
Jul 31 22:30:39.253420 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.253030    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv" event={"ID":"9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f","Type":"ContainerDied","Data":"5b56b5041d71d8ddb5cbd8ee0b0bd518cbbc0e48d5fd2906d6922af23a3a16f5"}
Jul 31 22:30:39.253420 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.253074    2577 scope.go:117] "RemoveContainer" containerID="a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28"
Jul 31 22:30:39.254701 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.254682    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"
Jul 31 22:30:39.254776 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.254739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2" event={"ID":"0c39a4d0-f7e2-41b2-b355-965a389f0ea6","Type":"ContainerDied","Data":"5b56f4963250a1bf2c56465a56127bf27e0c458bb40303ef88a811a675add19d"}
Jul 31 22:30:39.256141 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.256115    2577 generic.go:356] "Generic (PLEG): container finished" podID="9f8d0938-5f1e-4883-b30a-c935e25cbde6" containerID="10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f" exitCode=0
Jul 31 22:30:39.256283 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.256154    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"
Jul 31 22:30:39.256283 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.256196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4" event={"ID":"9f8d0938-5f1e-4883-b30a-c935e25cbde6","Type":"ContainerDied","Data":"10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f"}
Jul 31 22:30:39.256283 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.256246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4" event={"ID":"9f8d0938-5f1e-4883-b30a-c935e25cbde6","Type":"ContainerDied","Data":"3bd00095d6a450804f1c967bef5fb8e4657a7c2f0168992e10741dd0c0fa45fd"}
Jul 31 22:30:39.262783 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.262666    2577 scope.go:117] "RemoveContainer" containerID="a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28"
Jul 31 22:30:39.263146 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:30:39.263116    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28\": container with ID starting with a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28 not found: ID does not exist" containerID="a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28"
Jul 31 22:30:39.263266 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.263159    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28"} err="failed to get container status \"a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28\": rpc error: code = NotFound desc = could not find container \"a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28\": container with ID starting with a3265e3176dbb6812e8c0c72108bfe60aaeae8fa95a69452379972af7c3caa28 not found: ID does not exist"
Jul 31 22:30:39.263341 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.263267    2577 scope.go:117] "RemoveContainer" containerID="1c26271c031a4481f1295c45437dd1545d4889e7bc935790fed07bd446fdb76b"
Jul 31 22:30:39.272886 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.272869    2577 scope.go:117] "RemoveContainer" containerID="10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f"
Jul 31 22:30:39.277761 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.277738    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"]
Jul 31 22:30:39.281373 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.281355    2577 scope.go:117] "RemoveContainer" containerID="10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f"
Jul 31 22:30:39.281658 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:30:39.281639    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f\": container with ID starting with 10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f not found: ID does not exist" containerID="10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f"
Jul 31 22:30:39.281709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.281669    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f"} err="failed to get container status \"10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f\": rpc error: code = NotFound desc = could not find container \"10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f\": container with ID starting with 10e2ae818a8ad7d77571d49c2ee6eb7f12d861c3729d27a8fce06574c9cc895f not found: ID does not exist"
Jul 31 22:30:39.283308 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.283285    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a6187704-dc4d6c4-bjlmv"]
Jul 31 22:30:39.297352 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.297329    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"]
Jul 31 22:30:39.300827 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.300802    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a6187704-df7bc54cd-8fhz2"]
Jul 31 22:30:39.315993 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.315961    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"]
Jul 31 22:30:39.325660 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:39.325633    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a6187704-84788b9fb4-9fkk4"]
Jul 31 22:30:40.532226 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:40.532195    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c39a4d0-f7e2-41b2-b355-965a389f0ea6" path="/var/lib/kubelet/pods/0c39a4d0-f7e2-41b2-b355-965a389f0ea6/volumes"
Jul 31 22:30:40.532609 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:40.532561    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f" path="/var/lib/kubelet/pods/9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f/volumes"
Jul 31 22:30:40.532866 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:30:40.532853    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8d0938-5f1e-4883-b30a-c935e25cbde6" path="/var/lib/kubelet/pods/9f8d0938-5f1e-4883-b30a-c935e25cbde6/volumes"
Jul 31 22:32:39.809044 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809006    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"]
Jul 31 22:32:39.809571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809455    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c39a4d0-f7e2-41b2-b355-965a389f0ea6" containerName="maas-api"
Jul 31 22:32:39.809571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809468    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c39a4d0-f7e2-41b2-b355-965a389f0ea6" containerName="maas-api"
Jul 31 22:32:39.809571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809484    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f" containerName="payload-processing"
Jul 31 22:32:39.809571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809489    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f" containerName="payload-processing"
Jul 31 22:32:39.809571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809510    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8d0938-5f1e-4883-b30a-c935e25cbde6" containerName="payload-pre-processing"
Jul 31 22:32:39.809571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809518    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8d0938-5f1e-4883-b30a-c935e25cbde6" containerName="payload-pre-processing"
Jul 31 22:32:39.809770 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809581    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0a269f-6f1a-4b58-b9ff-f93e9a46e77f" containerName="payload-processing"
Jul 31 22:32:39.809770 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809593    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c39a4d0-f7e2-41b2-b355-965a389f0ea6" containerName="maas-api"
Jul 31 22:32:39.809770 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.809602    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8d0938-5f1e-4883-b30a-c935e25cbde6" containerName="payload-pre-processing"
Jul 31 22:32:39.812862 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.812841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.815159 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.815135    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d8ee576a-serving-cert\""
Jul 31 22:32:39.822000 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.821972    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"]
Jul 31 22:32:39.861289 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.861256    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/379fc816-2e9e-49be-b789-2e944c40b3ac-openshift-service-ca\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.861439 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.861302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgpxd\" (UniqueName: \"kubernetes.io/projected/379fc816-2e9e-49be-b789-2e944c40b3ac-kube-api-access-zgpxd\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.861439 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.861379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/379fc816-2e9e-49be-b789-2e944c40b3ac-maas-api-tls\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.962003 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.961964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/379fc816-2e9e-49be-b789-2e944c40b3ac-openshift-service-ca\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.962238 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.962010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgpxd\" (UniqueName: \"kubernetes.io/projected/379fc816-2e9e-49be-b789-2e944c40b3ac-kube-api-access-zgpxd\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.962238 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.962051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/379fc816-2e9e-49be-b789-2e944c40b3ac-maas-api-tls\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.962643 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.962620    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/379fc816-2e9e-49be-b789-2e944c40b3ac-openshift-service-ca\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.964471 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.964449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/379fc816-2e9e-49be-b789-2e944c40b3ac-maas-api-tls\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:39.973542 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:39.973523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgpxd\" (UniqueName: \"kubernetes.io/projected/379fc816-2e9e-49be-b789-2e944c40b3ac-kube-api-access-zgpxd\") pod \"maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:40.126117 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.126081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:40.260871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.260844    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"]
Jul 31 22:32:40.262832 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:32:40.262789    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod379fc816_2e9e_49be_b789_2e944c40b3ac.slice/crio-d65c1d66ee7b034528b1deb72c1bb389f4892e490341195b4efe64a1e9793132 WatchSource:0}: Error finding container d65c1d66ee7b034528b1deb72c1bb389f4892e490341195b4efe64a1e9793132: Status 404 returned error can't find the container with id d65c1d66ee7b034528b1deb72c1bb389f4892e490341195b4efe64a1e9793132
Jul 31 22:32:40.476866 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.476778    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"]
Jul 31 22:32:40.481140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.481118    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:40.483438 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.483417    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d8ee576a\""
Jul 31 22:32:40.483500 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.483419    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d8ee576a-dockercfg-24769\""
Jul 31 22:32:40.492669 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.492646    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"]
Jul 31 22:32:40.510928 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.510904    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"]
Jul 31 22:32:40.514270 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.514249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:40.524595 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.524570    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"]
Jul 31 22:32:40.568306 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.568272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w\" (UID: \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\") " pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:40.568478 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.568311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v29mr\" (UniqueName: \"kubernetes.io/projected/10cead04-5c64-4e82-a06a-009122309436-kube-api-access-v29mr\") pod \"payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5\" (UID: \"10cead04-5c64-4e82-a06a-009122309436\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:40.568478 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.568404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cead04-5c64-4e82-a06a-009122309436-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5\" (UID: \"10cead04-5c64-4e82-a06a-009122309436\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:40.568478 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.568461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j5lk\" (UniqueName: \"kubernetes.io/projected/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-kube-api-access-6j5lk\") pod \"payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w\" (UID: \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\") " pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:40.669143 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.669099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w\" (UID: \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\") " pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:40.669143 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.669145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v29mr\" (UniqueName: \"kubernetes.io/projected/10cead04-5c64-4e82-a06a-009122309436-kube-api-access-v29mr\") pod \"payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5\" (UID: \"10cead04-5c64-4e82-a06a-009122309436\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:40.669421 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.669208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cead04-5c64-4e82-a06a-009122309436-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5\" (UID: \"10cead04-5c64-4e82-a06a-009122309436\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:40.669421 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.669241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j5lk\" (UniqueName: \"kubernetes.io/projected/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-kube-api-access-6j5lk\") pod \"payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w\" (UID: \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\") " pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:40.669893 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.669874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cead04-5c64-4e82-a06a-009122309436-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5\" (UID: \"10cead04-5c64-4e82-a06a-009122309436\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:40.669931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.669883    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-plugins-config-volume\") pod \"payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w\" (UID: \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\") " pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:40.678990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.678960    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v29mr\" (UniqueName: \"kubernetes.io/projected/10cead04-5c64-4e82-a06a-009122309436-kube-api-access-v29mr\") pod \"payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5\" (UID: \"10cead04-5c64-4e82-a06a-009122309436\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:40.678990 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.678971    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j5lk\" (UniqueName: \"kubernetes.io/projected/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-kube-api-access-6j5lk\") pod \"payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w\" (UID: \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\") " pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:40.793823 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.793803    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:40.825571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.825550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:40.907991 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.907936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg" event={"ID":"379fc816-2e9e-49be-b789-2e944c40b3ac","Type":"ContainerStarted","Data":"2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428"}
Jul 31 22:32:40.908216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.908038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg" event={"ID":"379fc816-2e9e-49be-b789-2e944c40b3ac","Type":"ContainerStarted","Data":"d65c1d66ee7b034528b1deb72c1bb389f4892e490341195b4efe64a1e9793132"}
Jul 31 22:32:40.908313 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.908301    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:40.924680 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.924480    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg" podStartSLOduration=1.397339649 podStartE2EDuration="1.924458337s" totalImagesPullingTime="527.118688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:32:40.923806112 +0000 UTC m=+1952.876892341" watchObservedRunningTime="2026-07-31 22:32:40.924458337 +0000 UTC m=+1952.877544567"
Jul 31 22:32:40.953700 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.953668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"]
Jul 31 22:32:40.956348 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:32:40.956310    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210aea2d_9e26_4a9c_aa02_8583dcb6f35f.slice/crio-bc14bb1b0f58da8b2d3b3d24ef55fd1a47fb69cf838bc0d158777b1d72ec49f2 WatchSource:0}: Error finding container bc14bb1b0f58da8b2d3b3d24ef55fd1a47fb69cf838bc0d158777b1d72ec49f2: Status 404 returned error can't find the container with id bc14bb1b0f58da8b2d3b3d24ef55fd1a47fb69cf838bc0d158777b1d72ec49f2
Jul 31 22:32:40.989037 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:40.989010    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"]
Jul 31 22:32:40.991163 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:32:40.991135    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10cead04_5c64_4e82_a06a_009122309436.slice/crio-a310ce3ffb773ff6478ca394b3595201fec6aeb2f7bb8a6fe484f0cf83ff387d WatchSource:0}: Error finding container a310ce3ffb773ff6478ca394b3595201fec6aeb2f7bb8a6fe484f0cf83ff387d: Status 404 returned error can't find the container with id a310ce3ffb773ff6478ca394b3595201fec6aeb2f7bb8a6fe484f0cf83ff387d
Jul 31 22:32:41.914252 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:41.914211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5" event={"ID":"10cead04-5c64-4e82-a06a-009122309436","Type":"ContainerStarted","Data":"bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3"}
Jul 31 22:32:41.914740 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:41.914279    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5" event={"ID":"10cead04-5c64-4e82-a06a-009122309436","Type":"ContainerStarted","Data":"a310ce3ffb773ff6478ca394b3595201fec6aeb2f7bb8a6fe484f0cf83ff387d"}
Jul 31 22:32:41.914740 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:41.914312    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:41.915862 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:41.915835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w" event={"ID":"210aea2d-9e26-4a9c-aa02-8583dcb6f35f","Type":"ContainerStarted","Data":"90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21"}
Jul 31 22:32:41.916022 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:41.916005    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:32:41.916101 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:41.916049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w" event={"ID":"210aea2d-9e26-4a9c-aa02-8583dcb6f35f","Type":"ContainerStarted","Data":"bc14bb1b0f58da8b2d3b3d24ef55fd1a47fb69cf838bc0d158777b1d72ec49f2"}
Jul 31 22:32:41.928101 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:41.928048    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5" podStartSLOduration=1.928032007 podStartE2EDuration="1.928032007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:32:41.92798833 +0000 UTC m=+1953.881074560" watchObservedRunningTime="2026-07-31 22:32:41.928032007 +0000 UTC m=+1953.881118218"
Jul 31 22:32:41.944779 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:41.944727    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w" podStartSLOduration=1.944711705 podStartE2EDuration="1.944711705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:32:41.94351301 +0000 UTC m=+1953.896599264" watchObservedRunningTime="2026-07-31 22:32:41.944711705 +0000 UTC m=+1953.897797934"
Jul 31 22:32:46.921316 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:46.921284    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:32:52.923265 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:52.923230    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:32:52.923687 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:32:52.923303    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:33:21.451549 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.451511    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"]
Jul 31 22:33:21.452403 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.452346    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg" podUID="379fc816-2e9e-49be-b789-2e944c40b3ac" containerName="maas-api" containerID="cri-o://2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428" gracePeriod=30
Jul 31 22:33:21.506697 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.506658    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"]
Jul 31 22:33:21.506973 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.506917    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w" podUID="210aea2d-9e26-4a9c-aa02-8583dcb6f35f" containerName="payload-processing" containerID="cri-o://90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21" gracePeriod=30
Jul 31 22:33:21.511824 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.511210    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"]
Jul 31 22:33:21.511824 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.511478    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5" podUID="10cead04-5c64-4e82-a06a-009122309436" containerName="payload-pre-processing" containerID="cri-o://bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3" gracePeriod=30
Jul 31 22:33:21.770568 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.770543    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:33:21.773930 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.773903    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:33:21.800812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.800787    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:33:21.859288 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859250    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v29mr\" (UniqueName: \"kubernetes.io/projected/10cead04-5c64-4e82-a06a-009122309436-kube-api-access-v29mr\") pod \"10cead04-5c64-4e82-a06a-009122309436\" (UID: \"10cead04-5c64-4e82-a06a-009122309436\") "
Jul 31 22:33:21.859469 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859315    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cead04-5c64-4e82-a06a-009122309436-plugins-config-volume\") pod \"10cead04-5c64-4e82-a06a-009122309436\" (UID: \"10cead04-5c64-4e82-a06a-009122309436\") "
Jul 31 22:33:21.859469 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859355    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j5lk\" (UniqueName: \"kubernetes.io/projected/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-kube-api-access-6j5lk\") pod \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\" (UID: \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\") "
Jul 31 22:33:21.859469 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859385    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/379fc816-2e9e-49be-b789-2e944c40b3ac-openshift-service-ca\") pod \"379fc816-2e9e-49be-b789-2e944c40b3ac\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") "
Jul 31 22:33:21.859469 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859407    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/379fc816-2e9e-49be-b789-2e944c40b3ac-maas-api-tls\") pod \"379fc816-2e9e-49be-b789-2e944c40b3ac\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") "
Jul 31 22:33:21.859469 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859430    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-plugins-config-volume\") pod \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\" (UID: \"210aea2d-9e26-4a9c-aa02-8583dcb6f35f\") "
Jul 31 22:33:21.859744 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859472    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgpxd\" (UniqueName: \"kubernetes.io/projected/379fc816-2e9e-49be-b789-2e944c40b3ac-kube-api-access-zgpxd\") pod \"379fc816-2e9e-49be-b789-2e944c40b3ac\" (UID: \"379fc816-2e9e-49be-b789-2e944c40b3ac\") "
Jul 31 22:33:21.859867 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859788    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/379fc816-2e9e-49be-b789-2e944c40b3ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "379fc816-2e9e-49be-b789-2e944c40b3ac" (UID: "379fc816-2e9e-49be-b789-2e944c40b3ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:33:21.859867 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.859796    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10cead04-5c64-4e82-a06a-009122309436-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "10cead04-5c64-4e82-a06a-009122309436" (UID: "10cead04-5c64-4e82-a06a-009122309436"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:33:21.860069 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.860013    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "210aea2d-9e26-4a9c-aa02-8583dcb6f35f" (UID: "210aea2d-9e26-4a9c-aa02-8583dcb6f35f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:33:21.861743 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.861716    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/379fc816-2e9e-49be-b789-2e944c40b3ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "379fc816-2e9e-49be-b789-2e944c40b3ac" (UID: "379fc816-2e9e-49be-b789-2e944c40b3ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:33:21.861849 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.861753    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379fc816-2e9e-49be-b789-2e944c40b3ac-kube-api-access-zgpxd" (OuterVolumeSpecName: "kube-api-access-zgpxd") pod "379fc816-2e9e-49be-b789-2e944c40b3ac" (UID: "379fc816-2e9e-49be-b789-2e944c40b3ac"). InnerVolumeSpecName "kube-api-access-zgpxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:33:21.861908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.861892    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-kube-api-access-6j5lk" (OuterVolumeSpecName: "kube-api-access-6j5lk") pod "210aea2d-9e26-4a9c-aa02-8583dcb6f35f" (UID: "210aea2d-9e26-4a9c-aa02-8583dcb6f35f"). InnerVolumeSpecName "kube-api-access-6j5lk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:33:21.861946 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.861899    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10cead04-5c64-4e82-a06a-009122309436-kube-api-access-v29mr" (OuterVolumeSpecName: "kube-api-access-v29mr") pod "10cead04-5c64-4e82-a06a-009122309436" (UID: "10cead04-5c64-4e82-a06a-009122309436"). InnerVolumeSpecName "kube-api-access-v29mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:33:21.961162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.961052    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v29mr\" (UniqueName: \"kubernetes.io/projected/10cead04-5c64-4e82-a06a-009122309436-kube-api-access-v29mr\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:33:21.961162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.961086    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10cead04-5c64-4e82-a06a-009122309436-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:33:21.961162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.961099    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j5lk\" (UniqueName: \"kubernetes.io/projected/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-kube-api-access-6j5lk\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:33:21.961162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.961111    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/379fc816-2e9e-49be-b789-2e944c40b3ac-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:33:21.961162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.961124    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/379fc816-2e9e-49be-b789-2e944c40b3ac-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:33:21.961162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.961136    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210aea2d-9e26-4a9c-aa02-8583dcb6f35f-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:33:21.961162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:21.961148    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgpxd\" (UniqueName: \"kubernetes.io/projected/379fc816-2e9e-49be-b789-2e944c40b3ac-kube-api-access-zgpxd\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:33:22.139351 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.139312    2577 generic.go:356] "Generic (PLEG): container finished" podID="10cead04-5c64-4e82-a06a-009122309436" containerID="bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3" exitCode=0
Jul 31 22:33:22.139538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.139356    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"
Jul 31 22:33:22.139538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.139385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5" event={"ID":"10cead04-5c64-4e82-a06a-009122309436","Type":"ContainerDied","Data":"bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3"}
Jul 31 22:33:22.139538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.139440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5" event={"ID":"10cead04-5c64-4e82-a06a-009122309436","Type":"ContainerDied","Data":"a310ce3ffb773ff6478ca394b3595201fec6aeb2f7bb8a6fe484f0cf83ff387d"}
Jul 31 22:33:22.139538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.139472    2577 scope.go:117] "RemoveContainer" containerID="bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3"
Jul 31 22:33:22.140732 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.140713    2577 generic.go:356] "Generic (PLEG): container finished" podID="210aea2d-9e26-4a9c-aa02-8583dcb6f35f" containerID="90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21" exitCode=0
Jul 31 22:33:22.140833 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.140759    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"
Jul 31 22:33:22.140833 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.140801    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w" event={"ID":"210aea2d-9e26-4a9c-aa02-8583dcb6f35f","Type":"ContainerDied","Data":"90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21"}
Jul 31 22:33:22.140949 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.140849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w" event={"ID":"210aea2d-9e26-4a9c-aa02-8583dcb6f35f","Type":"ContainerDied","Data":"bc14bb1b0f58da8b2d3b3d24ef55fd1a47fb69cf838bc0d158777b1d72ec49f2"}
Jul 31 22:33:22.142025 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.142003    2577 generic.go:356] "Generic (PLEG): container finished" podID="379fc816-2e9e-49be-b789-2e944c40b3ac" containerID="2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428" exitCode=0
Jul 31 22:33:22.142140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.142056    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"
Jul 31 22:33:22.142140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.142054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg" event={"ID":"379fc816-2e9e-49be-b789-2e944c40b3ac","Type":"ContainerDied","Data":"2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428"}
Jul 31 22:33:22.142140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.142103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg" event={"ID":"379fc816-2e9e-49be-b789-2e944c40b3ac","Type":"ContainerDied","Data":"d65c1d66ee7b034528b1deb72c1bb389f4892e490341195b4efe64a1e9793132"}
Jul 31 22:33:22.150515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.150478    2577 scope.go:117] "RemoveContainer" containerID="bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3"
Jul 31 22:33:22.150822 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:33:22.150802    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3\": container with ID starting with bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3 not found: ID does not exist" containerID="bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3"
Jul 31 22:33:22.150923 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.150833    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3"} err="failed to get container status \"bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3\": rpc error: code = NotFound desc = could not find container \"bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3\": container with ID starting with bf707773afd16a5b63f7d05d9f0bf8add8a723f286c5725fadfc148013e371e3 not found: ID does not exist"
Jul 31 22:33:22.150923 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.150858    2577 scope.go:117] "RemoveContainer" containerID="90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21"
Jul 31 22:33:22.161961 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.161938    2577 scope.go:117] "RemoveContainer" containerID="90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21"
Jul 31 22:33:22.162496 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:33:22.162472    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21\": container with ID starting with 90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21 not found: ID does not exist" containerID="90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21"
Jul 31 22:33:22.162617 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.162503    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21"} err="failed to get container status \"90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21\": rpc error: code = NotFound desc = could not find container \"90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21\": container with ID starting with 90555fdddf07dab45ebb33a3be942241538d5dc182254093a6f3cf6fbafb5c21 not found: ID does not exist"
Jul 31 22:33:22.162617 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.162523    2577 scope.go:117] "RemoveContainer" containerID="2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428"
Jul 31 22:33:22.168477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.168450    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"]
Jul 31 22:33:22.170947 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.170923    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d8ee576a-68fff96f84-q2qv5"]
Jul 31 22:33:22.172876 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.172858    2577 scope.go:117] "RemoveContainer" containerID="2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428"
Jul 31 22:33:22.173168 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:33:22.173148    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428\": container with ID starting with 2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428 not found: ID does not exist" containerID="2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428"
Jul 31 22:33:22.173282 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.173198    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428"} err="failed to get container status \"2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428\": rpc error: code = NotFound desc = could not find container \"2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428\": container with ID starting with 2367d53737d4164fd1d9bf914143336dc07a7e7c0c17af00aa47b913bd37b428 not found: ID does not exist"
Jul 31 22:33:22.180534 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.180506    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"]
Jul 31 22:33:22.184158 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.184135    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d8ee576a-7b754c84f5-gzcgg"]
Jul 31 22:33:22.193947 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.193916    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"]
Jul 31 22:33:22.197499 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.197474    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d8ee576a-5f78db9df4-qr27w"]
Jul 31 22:33:22.534043 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.534005    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10cead04-5c64-4e82-a06a-009122309436" path="/var/lib/kubelet/pods/10cead04-5c64-4e82-a06a-009122309436/volumes"
Jul 31 22:33:22.534425 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.534410    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210aea2d-9e26-4a9c-aa02-8583dcb6f35f" path="/var/lib/kubelet/pods/210aea2d-9e26-4a9c-aa02-8583dcb6f35f/volumes"
Jul 31 22:33:22.534758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:33:22.534745    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="379fc816-2e9e-49be-b789-2e944c40b3ac" path="/var/lib/kubelet/pods/379fc816-2e9e-49be-b789-2e944c40b3ac/volumes"
Jul 31 22:35:47.745215 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745164    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"]
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745580    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="379fc816-2e9e-49be-b789-2e944c40b3ac" containerName="maas-api"
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745593    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="379fc816-2e9e-49be-b789-2e944c40b3ac" containerName="maas-api"
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745605    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10cead04-5c64-4e82-a06a-009122309436" containerName="payload-pre-processing"
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745611    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="10cead04-5c64-4e82-a06a-009122309436" containerName="payload-pre-processing"
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745624    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210aea2d-9e26-4a9c-aa02-8583dcb6f35f" containerName="payload-processing"
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745630    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="210aea2d-9e26-4a9c-aa02-8583dcb6f35f" containerName="payload-processing"
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745681    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="10cead04-5c64-4e82-a06a-009122309436" containerName="payload-pre-processing"
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745690    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="210aea2d-9e26-4a9c-aa02-8583dcb6f35f" containerName="payload-processing"
Jul 31 22:35:47.745750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.745697    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="379fc816-2e9e-49be-b789-2e944c40b3ac" containerName="maas-api"
Jul 31 22:35:47.748730 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.748706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.751224 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.751199    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9c96e5e7-serving-cert\""
Jul 31 22:35:47.759577 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.759553    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"]
Jul 31 22:35:47.875262 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.875229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c776e441-c01d-4865-a1d7-5174ace3d4fc-maas-api-tls\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.875440 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.875283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776e441-c01d-4865-a1d7-5174ace3d4fc-openshift-service-ca\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.875440 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.875406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4pgj\" (UniqueName: \"kubernetes.io/projected/c776e441-c01d-4865-a1d7-5174ace3d4fc-kube-api-access-c4pgj\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.976379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.976342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4pgj\" (UniqueName: \"kubernetes.io/projected/c776e441-c01d-4865-a1d7-5174ace3d4fc-kube-api-access-c4pgj\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.976559 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.976416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c776e441-c01d-4865-a1d7-5174ace3d4fc-maas-api-tls\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.976559 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.976460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776e441-c01d-4865-a1d7-5174ace3d4fc-openshift-service-ca\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.977139 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.977116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776e441-c01d-4865-a1d7-5174ace3d4fc-openshift-service-ca\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.978818 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.978794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c776e441-c01d-4865-a1d7-5174ace3d4fc-maas-api-tls\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:47.983691 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:47.983671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4pgj\" (UniqueName: \"kubernetes.io/projected/c776e441-c01d-4865-a1d7-5174ace3d4fc-kube-api-access-c4pgj\") pod \"maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:48.060645 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.060553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:48.199517 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.199492    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"]
Jul 31 22:35:48.201486 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:35:48.201458    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc776e441_c01d_4865_a1d7_5174ace3d4fc.slice/crio-583373dd5e7516285bf6ed8f7bbd0bc1e796f1d59b58ba5095b314a20871028a WatchSource:0}: Error finding container 583373dd5e7516285bf6ed8f7bbd0bc1e796f1d59b58ba5095b314a20871028a: Status 404 returned error can't find the container with id 583373dd5e7516285bf6ed8f7bbd0bc1e796f1d59b58ba5095b314a20871028a
Jul 31 22:35:48.202783 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.202762    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:35:48.419397 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.419363    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"]
Jul 31 22:35:48.423788 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.423773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:48.426272 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.426250    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9c96e5e7\""
Jul 31 22:35:48.426410 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.426280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-9c96e5e7-dockercfg-wrgsl\""
Jul 31 22:35:48.434648 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.434622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"]
Jul 31 22:35:48.437896 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.437869    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"]
Jul 31 22:35:48.441435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.441417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:48.451026 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.451005    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"]
Jul 31 22:35:48.482631 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.482589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p769k\" (UniqueName: \"kubernetes.io/projected/a310d58a-b7e5-4bcb-abbe-9115f4623767-kube-api-access-p769k\") pod \"payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7\" (UID: \"a310d58a-b7e5-4bcb-abbe-9115f4623767\") " pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:48.482796 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.482687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a310d58a-b7e5-4bcb-abbe-9115f4623767-plugins-config-volume\") pod \"payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7\" (UID: \"a310d58a-b7e5-4bcb-abbe-9115f4623767\") " pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:48.482796 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.482712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff181e31-4709-4964-9ea4-575a772a3efc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj\" (UID: \"ff181e31-4709-4964-9ea4-575a772a3efc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:48.482796 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.482786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4fbd\" (UniqueName: \"kubernetes.io/projected/ff181e31-4709-4964-9ea4-575a772a3efc-kube-api-access-c4fbd\") pod \"payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj\" (UID: \"ff181e31-4709-4964-9ea4-575a772a3efc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:48.583758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.583726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a310d58a-b7e5-4bcb-abbe-9115f4623767-plugins-config-volume\") pod \"payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7\" (UID: \"a310d58a-b7e5-4bcb-abbe-9115f4623767\") " pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:48.583758 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.583761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff181e31-4709-4964-9ea4-575a772a3efc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj\" (UID: \"ff181e31-4709-4964-9ea4-575a772a3efc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:48.584087 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.583811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4fbd\" (UniqueName: \"kubernetes.io/projected/ff181e31-4709-4964-9ea4-575a772a3efc-kube-api-access-c4fbd\") pod \"payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj\" (UID: \"ff181e31-4709-4964-9ea4-575a772a3efc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:48.584087 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.583857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p769k\" (UniqueName: \"kubernetes.io/projected/a310d58a-b7e5-4bcb-abbe-9115f4623767-kube-api-access-p769k\") pod \"payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7\" (UID: \"a310d58a-b7e5-4bcb-abbe-9115f4623767\") " pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:48.584594 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.584569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff181e31-4709-4964-9ea4-575a772a3efc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj\" (UID: \"ff181e31-4709-4964-9ea4-575a772a3efc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:48.584594 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.584582    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a310d58a-b7e5-4bcb-abbe-9115f4623767-plugins-config-volume\") pod \"payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7\" (UID: \"a310d58a-b7e5-4bcb-abbe-9115f4623767\") " pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:48.591956 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.591933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p769k\" (UniqueName: \"kubernetes.io/projected/a310d58a-b7e5-4bcb-abbe-9115f4623767-kube-api-access-p769k\") pod \"payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7\" (UID: \"a310d58a-b7e5-4bcb-abbe-9115f4623767\") " pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:48.592053 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.591993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4fbd\" (UniqueName: \"kubernetes.io/projected/ff181e31-4709-4964-9ea4-575a772a3efc-kube-api-access-c4fbd\") pod \"payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj\" (UID: \"ff181e31-4709-4964-9ea4-575a772a3efc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:48.736471 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.736440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:48.753005 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.752975    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:48.891607 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.891569    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"]
Jul 31 22:35:48.892137 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:35:48.892107    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff181e31_4709_4964_9ea4_575a772a3efc.slice/crio-7e205f8c687e1edf36b9f6ec6ffca561466330ab01094a7744f9c4c818bdaf99 WatchSource:0}: Error finding container 7e205f8c687e1edf36b9f6ec6ffca561466330ab01094a7744f9c4c818bdaf99: Status 404 returned error can't find the container with id 7e205f8c687e1edf36b9f6ec6ffca561466330ab01094a7744f9c4c818bdaf99
Jul 31 22:35:48.914732 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.914704    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"]
Jul 31 22:35:48.917906 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.917877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj" event={"ID":"ff181e31-4709-4964-9ea4-575a772a3efc","Type":"ContainerStarted","Data":"7e205f8c687e1edf36b9f6ec6ffca561466330ab01094a7744f9c4c818bdaf99"}
Jul 31 22:35:48.919225 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.919200    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k" event={"ID":"c776e441-c01d-4865-a1d7-5174ace3d4fc","Type":"ContainerStarted","Data":"fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581"}
Jul 31 22:35:48.919311 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.919247    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k" event={"ID":"c776e441-c01d-4865-a1d7-5174ace3d4fc","Type":"ContainerStarted","Data":"583373dd5e7516285bf6ed8f7bbd0bc1e796f1d59b58ba5095b314a20871028a"}
Jul 31 22:35:48.919311 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.919298    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:35:48.922450 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:35:48.922427    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda310d58a_b7e5_4bcb_abbe_9115f4623767.slice/crio-18330fa9fb9300947e33ab85b28f04a404a326e4cf6a5e15ef2815bba65169b9 WatchSource:0}: Error finding container 18330fa9fb9300947e33ab85b28f04a404a326e4cf6a5e15ef2815bba65169b9: Status 404 returned error can't find the container with id 18330fa9fb9300947e33ab85b28f04a404a326e4cf6a5e15ef2815bba65169b9
Jul 31 22:35:48.936812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:48.936765    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k" podStartSLOduration=1.5015583750000001 podStartE2EDuration="1.936749878s" totalImagesPullingTime="435.191503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:35:48.934395306 +0000 UTC m=+2140.887481537" watchObservedRunningTime="2026-07-31 22:35:48.936749878 +0000 UTC m=+2140.889836108"
Jul 31 22:35:49.927895 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:49.927854    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7" event={"ID":"a310d58a-b7e5-4bcb-abbe-9115f4623767","Type":"ContainerStarted","Data":"146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da"}
Jul 31 22:35:49.928402 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:49.927925    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:35:49.928402 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:49.927951    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7" event={"ID":"a310d58a-b7e5-4bcb-abbe-9115f4623767","Type":"ContainerStarted","Data":"18330fa9fb9300947e33ab85b28f04a404a326e4cf6a5e15ef2815bba65169b9"}
Jul 31 22:35:49.929511 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:49.929483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj" event={"ID":"ff181e31-4709-4964-9ea4-575a772a3efc","Type":"ContainerStarted","Data":"a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49"}
Jul 31 22:35:49.929687 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:49.929673    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:35:49.944606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:49.944557    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7" podStartSLOduration=1.9445419579999998 podStartE2EDuration="1.944541958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:35:49.942581397 +0000 UTC m=+2141.895667628" watchObservedRunningTime="2026-07-31 22:35:49.944541958 +0000 UTC m=+2141.897628204"
Jul 31 22:35:49.960437 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:49.960370    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj" podStartSLOduration=1.9603506849999999 podStartE2EDuration="1.960350685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:35:49.957579527 +0000 UTC m=+2141.910665757" watchObservedRunningTime="2026-07-31 22:35:49.960350685 +0000 UTC m=+2141.913436917"
Jul 31 22:35:54.935269 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:35:54.935239    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:36:00.937906 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:00.937818    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:36:00.937906 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:00.937889    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:36:56.545044 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.545005    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"]
Jul 31 22:36:56.545560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.545364    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k" podUID="c776e441-c01d-4865-a1d7-5174ace3d4fc" containerName="maas-api" containerID="cri-o://fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581" gracePeriod=30
Jul 31 22:36:56.600003 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.599965    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"]
Jul 31 22:36:56.600249 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.600223    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7" podUID="a310d58a-b7e5-4bcb-abbe-9115f4623767" containerName="payload-processing" containerID="cri-o://146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da" gracePeriod=30
Jul 31 22:36:56.608134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.608034    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"]
Jul 31 22:36:56.608536 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.608267    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj" podUID="ff181e31-4709-4964-9ea4-575a772a3efc" containerName="payload-pre-processing" containerID="cri-o://a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49" gracePeriod=30
Jul 31 22:36:56.889605 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.889580    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:36:56.915222 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.915149    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:36:56.918450 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:56.918432    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:36:57.026219 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026160    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4fbd\" (UniqueName: \"kubernetes.io/projected/ff181e31-4709-4964-9ea4-575a772a3efc-kube-api-access-c4fbd\") pod \"ff181e31-4709-4964-9ea4-575a772a3efc\" (UID: \"ff181e31-4709-4964-9ea4-575a772a3efc\") "
Jul 31 22:36:57.026219 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026221    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4pgj\" (UniqueName: \"kubernetes.io/projected/c776e441-c01d-4865-a1d7-5174ace3d4fc-kube-api-access-c4pgj\") pod \"c776e441-c01d-4865-a1d7-5174ace3d4fc\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") "
Jul 31 22:36:57.026462 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026253    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff181e31-4709-4964-9ea4-575a772a3efc-plugins-config-volume\") pod \"ff181e31-4709-4964-9ea4-575a772a3efc\" (UID: \"ff181e31-4709-4964-9ea4-575a772a3efc\") "
Jul 31 22:36:57.026462 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026294    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c776e441-c01d-4865-a1d7-5174ace3d4fc-maas-api-tls\") pod \"c776e441-c01d-4865-a1d7-5174ace3d4fc\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") "
Jul 31 22:36:57.026462 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026323    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p769k\" (UniqueName: \"kubernetes.io/projected/a310d58a-b7e5-4bcb-abbe-9115f4623767-kube-api-access-p769k\") pod \"a310d58a-b7e5-4bcb-abbe-9115f4623767\" (UID: \"a310d58a-b7e5-4bcb-abbe-9115f4623767\") "
Jul 31 22:36:57.026462 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026367    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776e441-c01d-4865-a1d7-5174ace3d4fc-openshift-service-ca\") pod \"c776e441-c01d-4865-a1d7-5174ace3d4fc\" (UID: \"c776e441-c01d-4865-a1d7-5174ace3d4fc\") "
Jul 31 22:36:57.026462 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026387    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a310d58a-b7e5-4bcb-abbe-9115f4623767-plugins-config-volume\") pod \"a310d58a-b7e5-4bcb-abbe-9115f4623767\" (UID: \"a310d58a-b7e5-4bcb-abbe-9115f4623767\") "
Jul 31 22:36:57.026822 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026790    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c776e441-c01d-4865-a1d7-5174ace3d4fc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c776e441-c01d-4865-a1d7-5174ace3d4fc" (UID: "c776e441-c01d-4865-a1d7-5174ace3d4fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:36:57.026822 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026809    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a310d58a-b7e5-4bcb-abbe-9115f4623767-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a310d58a-b7e5-4bcb-abbe-9115f4623767" (UID: "a310d58a-b7e5-4bcb-abbe-9115f4623767"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:36:57.026947 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.026789    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff181e31-4709-4964-9ea4-575a772a3efc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff181e31-4709-4964-9ea4-575a772a3efc" (UID: "ff181e31-4709-4964-9ea4-575a772a3efc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:36:57.027040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.027024    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff181e31-4709-4964-9ea4-575a772a3efc-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:36:57.027099 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.027043    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c776e441-c01d-4865-a1d7-5174ace3d4fc-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:36:57.027099 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.027053    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a310d58a-b7e5-4bcb-abbe-9115f4623767-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:36:57.028530 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.028510    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a310d58a-b7e5-4bcb-abbe-9115f4623767-kube-api-access-p769k" (OuterVolumeSpecName: "kube-api-access-p769k") pod "a310d58a-b7e5-4bcb-abbe-9115f4623767" (UID: "a310d58a-b7e5-4bcb-abbe-9115f4623767"). InnerVolumeSpecName "kube-api-access-p769k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:36:57.028652 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.028528    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c776e441-c01d-4865-a1d7-5174ace3d4fc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c776e441-c01d-4865-a1d7-5174ace3d4fc" (UID: "c776e441-c01d-4865-a1d7-5174ace3d4fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:36:57.028742 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.028721    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c776e441-c01d-4865-a1d7-5174ace3d4fc-kube-api-access-c4pgj" (OuterVolumeSpecName: "kube-api-access-c4pgj") pod "c776e441-c01d-4865-a1d7-5174ace3d4fc" (UID: "c776e441-c01d-4865-a1d7-5174ace3d4fc"). InnerVolumeSpecName "kube-api-access-c4pgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:36:57.028832 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.028815    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff181e31-4709-4964-9ea4-575a772a3efc-kube-api-access-c4fbd" (OuterVolumeSpecName: "kube-api-access-c4fbd") pod "ff181e31-4709-4964-9ea4-575a772a3efc" (UID: "ff181e31-4709-4964-9ea4-575a772a3efc"). InnerVolumeSpecName "kube-api-access-c4fbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:36:57.128036 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.127989    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4fbd\" (UniqueName: \"kubernetes.io/projected/ff181e31-4709-4964-9ea4-575a772a3efc-kube-api-access-c4fbd\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:36:57.128036 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.128032    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4pgj\" (UniqueName: \"kubernetes.io/projected/c776e441-c01d-4865-a1d7-5174ace3d4fc-kube-api-access-c4pgj\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:36:57.128036 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.128042    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c776e441-c01d-4865-a1d7-5174ace3d4fc-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:36:57.128036 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.128051    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p769k\" (UniqueName: \"kubernetes.io/projected/a310d58a-b7e5-4bcb-abbe-9115f4623767-kube-api-access-p769k\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:36:57.291267 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.291226    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff181e31-4709-4964-9ea4-575a772a3efc" containerID="a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49" exitCode=0
Jul 31 22:36:57.291465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.291279    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"
Jul 31 22:36:57.291465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.291315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj" event={"ID":"ff181e31-4709-4964-9ea4-575a772a3efc","Type":"ContainerDied","Data":"a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49"}
Jul 31 22:36:57.291465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.291379    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj" event={"ID":"ff181e31-4709-4964-9ea4-575a772a3efc","Type":"ContainerDied","Data":"7e205f8c687e1edf36b9f6ec6ffca561466330ab01094a7744f9c4c818bdaf99"}
Jul 31 22:36:57.291465 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.291405    2577 scope.go:117] "RemoveContainer" containerID="a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49"
Jul 31 22:36:57.292606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.292582    2577 generic.go:356] "Generic (PLEG): container finished" podID="c776e441-c01d-4865-a1d7-5174ace3d4fc" containerID="fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581" exitCode=0
Jul 31 22:36:57.292717 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.292613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k" event={"ID":"c776e441-c01d-4865-a1d7-5174ace3d4fc","Type":"ContainerDied","Data":"fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581"}
Jul 31 22:36:57.292717 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.292671    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k" event={"ID":"c776e441-c01d-4865-a1d7-5174ace3d4fc","Type":"ContainerDied","Data":"583373dd5e7516285bf6ed8f7bbd0bc1e796f1d59b58ba5095b314a20871028a"}
Jul 31 22:36:57.292717 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.292628    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"
Jul 31 22:36:57.293989 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.293965    2577 generic.go:356] "Generic (PLEG): container finished" podID="a310d58a-b7e5-4bcb-abbe-9115f4623767" containerID="146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da" exitCode=0
Jul 31 22:36:57.294108 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.293998    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"
Jul 31 22:36:57.294108 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.294033    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7" event={"ID":"a310d58a-b7e5-4bcb-abbe-9115f4623767","Type":"ContainerDied","Data":"146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da"}
Jul 31 22:36:57.294108 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.294075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7" event={"ID":"a310d58a-b7e5-4bcb-abbe-9115f4623767","Type":"ContainerDied","Data":"18330fa9fb9300947e33ab85b28f04a404a326e4cf6a5e15ef2815bba65169b9"}
Jul 31 22:36:57.300891 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.300872    2577 scope.go:117] "RemoveContainer" containerID="a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49"
Jul 31 22:36:57.301127 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:36:57.301108    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49\": container with ID starting with a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49 not found: ID does not exist" containerID="a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49"
Jul 31 22:36:57.301227 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.301132    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49"} err="failed to get container status \"a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49\": rpc error: code = NotFound desc = could not find container \"a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49\": container with ID starting with a1867b763f7c600a2cf33a5793767ad3e72cea24319a459836a23490d9564d49 not found: ID does not exist"
Jul 31 22:36:57.301227 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.301150    2577 scope.go:117] "RemoveContainer" containerID="fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581"
Jul 31 22:36:57.310521 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.310504    2577 scope.go:117] "RemoveContainer" containerID="fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581"
Jul 31 22:36:57.310780 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:36:57.310762    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581\": container with ID starting with fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581 not found: ID does not exist" containerID="fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581"
Jul 31 22:36:57.310843 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.310786    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581"} err="failed to get container status \"fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581\": rpc error: code = NotFound desc = could not find container \"fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581\": container with ID starting with fc9861376195391277094558a956d31a723d53e0ad0416e9effd9594d6dd3581 not found: ID does not exist"
Jul 31 22:36:57.310843 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.310801    2577 scope.go:117] "RemoveContainer" containerID="146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da"
Jul 31 22:36:57.318814 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.318795    2577 scope.go:117] "RemoveContainer" containerID="146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da"
Jul 31 22:36:57.319091 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:36:57.319062    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da\": container with ID starting with 146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da not found: ID does not exist" containerID="146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da"
Jul 31 22:36:57.319157 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.319096    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da"} err="failed to get container status \"146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da\": rpc error: code = NotFound desc = could not find container \"146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da\": container with ID starting with 146c7fc84cfce673124a5b219ddb82affbbc46d1fb2dd2bd1c6641cefef540da not found: ID does not exist"
Jul 31 22:36:57.321673 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.321652    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"]
Jul 31 22:36:57.324652 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.324635    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9c96e5e7-76b599885b-p9ffj"]
Jul 31 22:36:57.333905 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.333887    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"]
Jul 31 22:36:57.337304 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.337284    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9c96e5e7-5f5fd5675d-7d9b7"]
Jul 31 22:36:57.347330 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.347311    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"]
Jul 31 22:36:57.351102 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:57.351082    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9c96e5e7-d9567bfbf-kmb6k"]
Jul 31 22:36:58.532409 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:58.532377    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a310d58a-b7e5-4bcb-abbe-9115f4623767" path="/var/lib/kubelet/pods/a310d58a-b7e5-4bcb-abbe-9115f4623767/volumes"
Jul 31 22:36:58.532787 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:58.532736    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c776e441-c01d-4865-a1d7-5174ace3d4fc" path="/var/lib/kubelet/pods/c776e441-c01d-4865-a1d7-5174ace3d4fc/volumes"
Jul 31 22:36:58.533042 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:36:58.533029    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff181e31-4709-4964-9ea4-575a772a3efc" path="/var/lib/kubelet/pods/ff181e31-4709-4964-9ea4-575a772a3efc/volumes"
Jul 31 22:39:20.831702 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.831669    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"]
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832042    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a310d58a-b7e5-4bcb-abbe-9115f4623767" containerName="payload-processing"
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832054    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a310d58a-b7e5-4bcb-abbe-9115f4623767" containerName="payload-processing"
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832073    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff181e31-4709-4964-9ea4-575a772a3efc" containerName="payload-pre-processing"
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832079    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff181e31-4709-4964-9ea4-575a772a3efc" containerName="payload-pre-processing"
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832096    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c776e441-c01d-4865-a1d7-5174ace3d4fc" containerName="maas-api"
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832102    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c776e441-c01d-4865-a1d7-5174ace3d4fc" containerName="maas-api"
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832152    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a310d58a-b7e5-4bcb-abbe-9115f4623767" containerName="payload-processing"
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832161    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff181e31-4709-4964-9ea4-575a772a3efc" containerName="payload-pre-processing"
Jul 31 22:39:20.834051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.832167    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c776e441-c01d-4865-a1d7-5174ace3d4fc" containerName="maas-api"
Jul 31 22:39:20.835155 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.835131    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:20.837578 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.837557    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-627bf7-serving-cert\""
Jul 31 22:39:20.850284 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.850260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"]
Jul 31 22:39:20.937216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.937165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9adad5dd-77a0-408e-b6db-5f4cfea832d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:20.937390 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.937236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:20.937390 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:20.937258    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ht5s\" (UniqueName: \"kubernetes.io/projected/9adad5dd-77a0-408e-b6db-5f4cfea832d7-kube-api-access-2ht5s\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.038316 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.038280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9adad5dd-77a0-408e-b6db-5f4cfea832d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.038316 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.038323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.038599 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.038348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ht5s\" (UniqueName: \"kubernetes.io/projected/9adad5dd-77a0-408e-b6db-5f4cfea832d7-kube-api-access-2ht5s\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.038599 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:39:21.038457    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-serving-cert: secret "maas-api-e2e-inf-a-627bf7-serving-cert" not found
Jul 31 22:39:21.038599 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:39:21.038548    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls podName:9adad5dd-77a0-408e-b6db-5f4cfea832d7 nodeName:}" failed. No retries permitted until 2026-07-31 22:39:21.538526365 +0000 UTC m=+2353.491612579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls") pod "maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p" (UID: "9adad5dd-77a0-408e-b6db-5f4cfea832d7") : secret "maas-api-e2e-inf-a-627bf7-serving-cert" not found
Jul 31 22:39:21.038946 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.038926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9adad5dd-77a0-408e-b6db-5f4cfea832d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.051600 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.051571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ht5s\" (UniqueName: \"kubernetes.io/projected/9adad5dd-77a0-408e-b6db-5f4cfea832d7-kube-api-access-2ht5s\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.526902 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.526854    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"]
Jul 31 22:39:21.530531 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.530506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:21.532906 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.532880    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-627bf7-dockercfg-l8n5z\""
Jul 31 22:39:21.533050 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.533019    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-627bf7\""
Jul 31 22:39:21.538923 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.538899    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"]
Jul 31 22:39:21.543903 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.543880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.546162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.546130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.591618 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.591577    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"]
Jul 31 22:39:21.595131 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.595107    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:21.605348 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.605321    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"]
Jul 31 22:39:21.645374 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.645330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a3817cc-3df0-48a7-99af-158b92b1ff44-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw\" (UID: \"5a3817cc-3df0-48a7-99af-158b92b1ff44\") " pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:21.645374 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.645369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmr2d\" (UniqueName: \"kubernetes.io/projected/5a3817cc-3df0-48a7-99af-158b92b1ff44-kube-api-access-vmr2d\") pod \"payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw\" (UID: \"5a3817cc-3df0-48a7-99af-158b92b1ff44\") " pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:21.645623 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.645482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghpws\" (UniqueName: \"kubernetes.io/projected/fd38caad-be25-438a-8240-68aa45555c37-kube-api-access-ghpws\") pod \"payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn\" (UID: \"fd38caad-be25-438a-8240-68aa45555c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:21.645623 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.645603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd38caad-be25-438a-8240-68aa45555c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn\" (UID: \"fd38caad-be25-438a-8240-68aa45555c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:21.746592 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.746551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd38caad-be25-438a-8240-68aa45555c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn\" (UID: \"fd38caad-be25-438a-8240-68aa45555c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:21.746592 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.746595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a3817cc-3df0-48a7-99af-158b92b1ff44-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw\" (UID: \"5a3817cc-3df0-48a7-99af-158b92b1ff44\") " pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:21.746853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.746611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmr2d\" (UniqueName: \"kubernetes.io/projected/5a3817cc-3df0-48a7-99af-158b92b1ff44-kube-api-access-vmr2d\") pod \"payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw\" (UID: \"5a3817cc-3df0-48a7-99af-158b92b1ff44\") " pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:21.746853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.746677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghpws\" (UniqueName: \"kubernetes.io/projected/fd38caad-be25-438a-8240-68aa45555c37-kube-api-access-ghpws\") pod \"payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn\" (UID: \"fd38caad-be25-438a-8240-68aa45555c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:21.747377 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.747357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd38caad-be25-438a-8240-68aa45555c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn\" (UID: \"fd38caad-be25-438a-8240-68aa45555c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:21.747377 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.747367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a3817cc-3df0-48a7-99af-158b92b1ff44-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw\" (UID: \"5a3817cc-3df0-48a7-99af-158b92b1ff44\") " pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:21.747469 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.747458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:21.755821 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.755790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghpws\" (UniqueName: \"kubernetes.io/projected/fd38caad-be25-438a-8240-68aa45555c37-kube-api-access-ghpws\") pod \"payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn\" (UID: \"fd38caad-be25-438a-8240-68aa45555c37\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:21.755948 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.755862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmr2d\" (UniqueName: \"kubernetes.io/projected/5a3817cc-3df0-48a7-99af-158b92b1ff44-kube-api-access-vmr2d\") pod \"payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw\" (UID: \"5a3817cc-3df0-48a7-99af-158b92b1ff44\") " pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:21.842595 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.842551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:21.907829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.907543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:21.911038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:21.911012    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"]
Jul 31 22:39:21.914564 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:39:21.914529    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adad5dd_77a0_408e_b6db_5f4cfea832d7.slice/crio-a1222dd6f25592877e14bb785c9dd8f6dab5849a1d959d72ad61d5c546108a67 WatchSource:0}: Error finding container a1222dd6f25592877e14bb785c9dd8f6dab5849a1d959d72ad61d5c546108a67: Status 404 returned error can't find the container with id a1222dd6f25592877e14bb785c9dd8f6dab5849a1d959d72ad61d5c546108a67
Jul 31 22:39:22.014784 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:22.014740    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"]
Jul 31 22:39:22.019263 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:39:22.019234    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a3817cc_3df0_48a7_99af_158b92b1ff44.slice/crio-68ff3e680186568779fbd5a4bb6dc1735f489e7860c489c9cb79b38726518dac WatchSource:0}: Error finding container 68ff3e680186568779fbd5a4bb6dc1735f489e7860c489c9cb79b38726518dac: Status 404 returned error can't find the container with id 68ff3e680186568779fbd5a4bb6dc1735f489e7860c489c9cb79b38726518dac
Jul 31 22:39:22.061497 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:22.061463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw" event={"ID":"5a3817cc-3df0-48a7-99af-158b92b1ff44","Type":"ContainerStarted","Data":"68ff3e680186568779fbd5a4bb6dc1735f489e7860c489c9cb79b38726518dac"}
Jul 31 22:39:22.062766 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:22.062737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p" event={"ID":"9adad5dd-77a0-408e-b6db-5f4cfea832d7","Type":"ContainerStarted","Data":"a1222dd6f25592877e14bb785c9dd8f6dab5849a1d959d72ad61d5c546108a67"}
Jul 31 22:39:22.084877 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:22.084847    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"]
Jul 31 22:39:22.087044 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:39:22.087010    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd38caad_be25_438a_8240_68aa45555c37.slice/crio-ca07a30b3c3ec6a621504703fa3af8a721661cbcb88853133e4b1c14a4dd6709 WatchSource:0}: Error finding container ca07a30b3c3ec6a621504703fa3af8a721661cbcb88853133e4b1c14a4dd6709: Status 404 returned error can't find the container with id ca07a30b3c3ec6a621504703fa3af8a721661cbcb88853133e4b1c14a4dd6709
Jul 31 22:39:23.069571 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.069530    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw" event={"ID":"5a3817cc-3df0-48a7-99af-158b92b1ff44","Type":"ContainerStarted","Data":"6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349"}
Jul 31 22:39:23.070089 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.069603    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:23.071285 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.071248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p" event={"ID":"9adad5dd-77a0-408e-b6db-5f4cfea832d7","Type":"ContainerStarted","Data":"40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf"}
Jul 31 22:39:23.071413 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.071309    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:23.072964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.072938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn" event={"ID":"fd38caad-be25-438a-8240-68aa45555c37","Type":"ContainerStarted","Data":"8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c"}
Jul 31 22:39:23.073070 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.072982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn" event={"ID":"fd38caad-be25-438a-8240-68aa45555c37","Type":"ContainerStarted","Data":"ca07a30b3c3ec6a621504703fa3af8a721661cbcb88853133e4b1c14a4dd6709"}
Jul 31 22:39:23.073070 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.073013    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:23.089431 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.089374    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw" podStartSLOduration=2.089355256 podStartE2EDuration="2.089355256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:39:23.085422171 +0000 UTC m=+2355.038508402" watchObservedRunningTime="2026-07-31 22:39:23.089355256 +0000 UTC m=+2355.042441486"
Jul 31 22:39:23.101534 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.101482    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn" podStartSLOduration=2.101469086 podStartE2EDuration="2.101469086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:39:23.100917886 +0000 UTC m=+2355.054004144" watchObservedRunningTime="2026-07-31 22:39:23.101469086 +0000 UTC m=+2355.054555314"
Jul 31 22:39:23.120942 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:23.120888    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p" podStartSLOduration=2.7329412140000002 podStartE2EDuration="3.120871306s" totalImagesPullingTime="387.930092ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:39:23.117962214 +0000 UTC m=+2355.071048442" watchObservedRunningTime="2026-07-31 22:39:23.120871306 +0000 UTC m=+2355.073957527"
Jul 31 22:39:29.083307 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:29.083267    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:39:34.080150 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:34.080120    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:39:34.080653 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:34.080221    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:39:50.238040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.238008    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"]
Jul 31 22:39:50.241554 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.241531    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.243988 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.243965    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ae5bab-serving-cert\""
Jul 31 22:39:50.259241 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.259213    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"]
Jul 31 22:39:50.408958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.408921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c415409-2ad6-48ec-8089-5d3508ff7456-maas-api-tls\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.409135 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.408978    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zp62\" (UniqueName: \"kubernetes.io/projected/7c415409-2ad6-48ec-8089-5d3508ff7456-kube-api-access-6zp62\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.409135 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.409018    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c415409-2ad6-48ec-8089-5d3508ff7456-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.510357 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.510259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zp62\" (UniqueName: \"kubernetes.io/projected/7c415409-2ad6-48ec-8089-5d3508ff7456-kube-api-access-6zp62\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.510357 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.510328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c415409-2ad6-48ec-8089-5d3508ff7456-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.510554 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.510430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c415409-2ad6-48ec-8089-5d3508ff7456-maas-api-tls\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.510964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.510942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c415409-2ad6-48ec-8089-5d3508ff7456-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.512816 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.512793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c415409-2ad6-48ec-8089-5d3508ff7456-maas-api-tls\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.520662 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.520639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zp62\" (UniqueName: \"kubernetes.io/projected/7c415409-2ad6-48ec-8089-5d3508ff7456-kube-api-access-6zp62\") pod \"maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.554633 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.554608    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:50.710310 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:50.710284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"]
Jul 31 22:39:50.712224 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:39:50.712144    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c415409_2ad6_48ec_8089_5d3508ff7456.slice/crio-acdc5697e668e90dd147f4e76ffe8fbea3a1f91d725d3c32ee2f0bc63148780d WatchSource:0}: Error finding container acdc5697e668e90dd147f4e76ffe8fbea3a1f91d725d3c32ee2f0bc63148780d: Status 404 returned error can't find the container with id acdc5697e668e90dd147f4e76ffe8fbea3a1f91d725d3c32ee2f0bc63148780d
Jul 31 22:39:51.221056 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.221019    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"]
Jul 31 22:39:51.225806 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.225775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:51.227458 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.227433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp" event={"ID":"7c415409-2ad6-48ec-8089-5d3508ff7456","Type":"ContainerStarted","Data":"b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5"}
Jul 31 22:39:51.227583 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.227480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp" event={"ID":"7c415409-2ad6-48ec-8089-5d3508ff7456","Type":"ContainerStarted","Data":"acdc5697e668e90dd147f4e76ffe8fbea3a1f91d725d3c32ee2f0bc63148780d"}
Jul 31 22:39:51.227642 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.227573    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:39:51.229412 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.229393    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-ae5bab\""
Jul 31 22:39:51.229529 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.229513    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-ae5bab-dockercfg-56clj\""
Jul 31 22:39:51.254960 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.254927    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"]
Jul 31 22:39:51.318012 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.317920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec80f25-e4bf-4196-bd36-ae484f569d58-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r\" (UID: \"4ec80f25-e4bf-4196-bd36-ae484f569d58\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:51.318207 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.318020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9cqr\" (UniqueName: \"kubernetes.io/projected/4ec80f25-e4bf-4196-bd36-ae484f569d58-kube-api-access-f9cqr\") pod \"payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r\" (UID: \"4ec80f25-e4bf-4196-bd36-ae484f569d58\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:51.323631 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.323565    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"]
Jul 31 22:39:51.324804 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.324748    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp" podStartSLOduration=0.990535339 podStartE2EDuration="1.324727196s" totalImagesPullingTime="334.191857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:39:51.311237628 +0000 UTC m=+2383.264323858" watchObservedRunningTime="2026-07-31 22:39:51.324727196 +0000 UTC m=+2383.277813418"
Jul 31 22:39:51.328586 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.328564    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:51.341104 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.341077    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"]
Jul 31 22:39:51.418948 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.418908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ljmh\" (UniqueName: \"kubernetes.io/projected/e6cc0bd1-6edf-415a-ba65-e1255935d889-kube-api-access-5ljmh\") pod \"payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt\" (UID: \"e6cc0bd1-6edf-415a-ba65-e1255935d889\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:51.419151 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.418993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6cc0bd1-6edf-415a-ba65-e1255935d889-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt\" (UID: \"e6cc0bd1-6edf-415a-ba65-e1255935d889\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:51.419151 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.419040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec80f25-e4bf-4196-bd36-ae484f569d58-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r\" (UID: \"4ec80f25-e4bf-4196-bd36-ae484f569d58\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:51.419151 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.419097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9cqr\" (UniqueName: \"kubernetes.io/projected/4ec80f25-e4bf-4196-bd36-ae484f569d58-kube-api-access-f9cqr\") pod \"payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r\" (UID: \"4ec80f25-e4bf-4196-bd36-ae484f569d58\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:51.419801 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.419743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec80f25-e4bf-4196-bd36-ae484f569d58-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r\" (UID: \"4ec80f25-e4bf-4196-bd36-ae484f569d58\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:51.433132 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.433108    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9cqr\" (UniqueName: \"kubernetes.io/projected/4ec80f25-e4bf-4196-bd36-ae484f569d58-kube-api-access-f9cqr\") pod \"payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r\" (UID: \"4ec80f25-e4bf-4196-bd36-ae484f569d58\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:51.519604 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.519570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6cc0bd1-6edf-415a-ba65-e1255935d889-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt\" (UID: \"e6cc0bd1-6edf-415a-ba65-e1255935d889\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:51.519791 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.519668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljmh\" (UniqueName: \"kubernetes.io/projected/e6cc0bd1-6edf-415a-ba65-e1255935d889-kube-api-access-5ljmh\") pod \"payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt\" (UID: \"e6cc0bd1-6edf-415a-ba65-e1255935d889\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:51.520479 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.520451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6cc0bd1-6edf-415a-ba65-e1255935d889-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt\" (UID: \"e6cc0bd1-6edf-415a-ba65-e1255935d889\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:51.535751 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.535721    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ljmh\" (UniqueName: \"kubernetes.io/projected/e6cc0bd1-6edf-415a-ba65-e1255935d889-kube-api-access-5ljmh\") pod \"payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt\" (UID: \"e6cc0bd1-6edf-415a-ba65-e1255935d889\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:51.535871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.535849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:51.642529 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.642494    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:51.685837 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.685754    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"]
Jul 31 22:39:51.689008 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:39:51.688978    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec80f25_e4bf_4196_bd36_ae484f569d58.slice/crio-7e23e7656c1b32b4670293e0c6d7bed7dbc39da05313f8aafb5c130ad49bde65 WatchSource:0}: Error finding container 7e23e7656c1b32b4670293e0c6d7bed7dbc39da05313f8aafb5c130ad49bde65: Status 404 returned error can't find the container with id 7e23e7656c1b32b4670293e0c6d7bed7dbc39da05313f8aafb5c130ad49bde65
Jul 31 22:39:51.794313 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:51.794289    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"]
Jul 31 22:39:51.795621 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:39:51.795593    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6cc0bd1_6edf_415a_ba65_e1255935d889.slice/crio-3624ac9f1605ebbd24c8b6ada3cb214b6a9603a529608d4132e88edc380f5226 WatchSource:0}: Error finding container 3624ac9f1605ebbd24c8b6ada3cb214b6a9603a529608d4132e88edc380f5226: Status 404 returned error can't find the container with id 3624ac9f1605ebbd24c8b6ada3cb214b6a9603a529608d4132e88edc380f5226
Jul 31 22:39:52.233853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:52.233754    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt" event={"ID":"e6cc0bd1-6edf-415a-ba65-e1255935d889","Type":"ContainerStarted","Data":"bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab"}
Jul 31 22:39:52.233853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:52.233817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt" event={"ID":"e6cc0bd1-6edf-415a-ba65-e1255935d889","Type":"ContainerStarted","Data":"3624ac9f1605ebbd24c8b6ada3cb214b6a9603a529608d4132e88edc380f5226"}
Jul 31 22:39:52.234084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:52.233944    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:39:52.235311 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:52.235287    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r" event={"ID":"4ec80f25-e4bf-4196-bd36-ae484f569d58","Type":"ContainerStarted","Data":"1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee"}
Jul 31 22:39:52.235448 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:52.235325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r" event={"ID":"4ec80f25-e4bf-4196-bd36-ae484f569d58","Type":"ContainerStarted","Data":"7e23e7656c1b32b4670293e0c6d7bed7dbc39da05313f8aafb5c130ad49bde65"}
Jul 31 22:39:52.235515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:52.235502    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:39:52.258932 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:52.258867    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt" podStartSLOduration=1.258837083 podStartE2EDuration="1.258837083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:39:52.254152002 +0000 UTC m=+2384.207238233" watchObservedRunningTime="2026-07-31 22:39:52.258837083 +0000 UTC m=+2384.211923314"
Jul 31 22:39:52.282763 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:52.282708    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r" podStartSLOduration=1.2826939259999999 podStartE2EDuration="1.282693926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:39:52.281800641 +0000 UTC m=+2384.234886875" watchObservedRunningTime="2026-07-31 22:39:52.282693926 +0000 UTC m=+2384.235780154"
Jul 31 22:39:57.241417 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:39:57.241386    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:40:03.242774 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:40:03.242741    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:40:03.243198 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:40:03.242901    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:41:50.443843 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.443803    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"]
Jul 31 22:41:50.444374 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.444061    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p" podUID="9adad5dd-77a0-408e-b6db-5f4cfea832d7" containerName="maas-api" containerID="cri-o://40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf" gracePeriod=30
Jul 31 22:41:50.495767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.495734    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"]
Jul 31 22:41:50.495999 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.495951    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw" podUID="5a3817cc-3df0-48a7-99af-158b92b1ff44" containerName="payload-processing" containerID="cri-o://6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349" gracePeriod=30
Jul 31 22:41:50.502931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.502903    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"]
Jul 31 22:41:50.503403 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.503326    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn" podUID="fd38caad-be25-438a-8240-68aa45555c37" containerName="payload-pre-processing" containerID="cri-o://8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c" gracePeriod=30
Jul 31 22:41:50.751060 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.751032    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:41:50.804562 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.804526    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:41:50.817432 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.817404    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:41:50.845970 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.845945    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9adad5dd-77a0-408e-b6db-5f4cfea832d7-openshift-service-ca\") pod \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") "
Jul 31 22:41:50.846113 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.846015    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ht5s\" (UniqueName: \"kubernetes.io/projected/9adad5dd-77a0-408e-b6db-5f4cfea832d7-kube-api-access-2ht5s\") pod \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") "
Jul 31 22:41:50.846113 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.846099    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls\") pod \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\" (UID: \"9adad5dd-77a0-408e-b6db-5f4cfea832d7\") "
Jul 31 22:41:50.846371 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.846346    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9adad5dd-77a0-408e-b6db-5f4cfea832d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9adad5dd-77a0-408e-b6db-5f4cfea832d7" (UID: "9adad5dd-77a0-408e-b6db-5f4cfea832d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:41:50.848106 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.848077    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9adad5dd-77a0-408e-b6db-5f4cfea832d7" (UID: "9adad5dd-77a0-408e-b6db-5f4cfea832d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:41:50.848241 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.848100    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adad5dd-77a0-408e-b6db-5f4cfea832d7-kube-api-access-2ht5s" (OuterVolumeSpecName: "kube-api-access-2ht5s") pod "9adad5dd-77a0-408e-b6db-5f4cfea832d7" (UID: "9adad5dd-77a0-408e-b6db-5f4cfea832d7"). InnerVolumeSpecName "kube-api-access-2ht5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:41:50.921306 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.921265    2577 generic.go:356] "Generic (PLEG): container finished" podID="fd38caad-be25-438a-8240-68aa45555c37" containerID="8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c" exitCode=0
Jul 31 22:41:50.927303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.921759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn" event={"ID":"fd38caad-be25-438a-8240-68aa45555c37","Type":"ContainerDied","Data":"8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c"}
Jul 31 22:41:50.927303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.921806    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"
Jul 31 22:41:50.927303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.921878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn" event={"ID":"fd38caad-be25-438a-8240-68aa45555c37","Type":"ContainerDied","Data":"ca07a30b3c3ec6a621504703fa3af8a721661cbcb88853133e4b1c14a4dd6709"}
Jul 31 22:41:50.927303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.921925    2577 scope.go:117] "RemoveContainer" containerID="8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c"
Jul 31 22:41:50.929057 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.929031    2577 generic.go:356] "Generic (PLEG): container finished" podID="5a3817cc-3df0-48a7-99af-158b92b1ff44" containerID="6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349" exitCode=0
Jul 31 22:41:50.929213 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.929101    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"
Jul 31 22:41:50.929213 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.929103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw" event={"ID":"5a3817cc-3df0-48a7-99af-158b92b1ff44","Type":"ContainerDied","Data":"6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349"}
Jul 31 22:41:50.929346 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.929244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw" event={"ID":"5a3817cc-3df0-48a7-99af-158b92b1ff44","Type":"ContainerDied","Data":"68ff3e680186568779fbd5a4bb6dc1735f489e7860c489c9cb79b38726518dac"}
Jul 31 22:41:50.930417 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.930396    2577 generic.go:356] "Generic (PLEG): container finished" podID="9adad5dd-77a0-408e-b6db-5f4cfea832d7" containerID="40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf" exitCode=0
Jul 31 22:41:50.930554 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.930438    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"
Jul 31 22:41:50.930554 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.930439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p" event={"ID":"9adad5dd-77a0-408e-b6db-5f4cfea832d7","Type":"ContainerDied","Data":"40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf"}
Jul 31 22:41:50.930554 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.930548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p" event={"ID":"9adad5dd-77a0-408e-b6db-5f4cfea832d7","Type":"ContainerDied","Data":"a1222dd6f25592877e14bb785c9dd8f6dab5849a1d959d72ad61d5c546108a67"}
Jul 31 22:41:50.939058 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.939028    2577 scope.go:117] "RemoveContainer" containerID="8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c"
Jul 31 22:41:50.939512 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:41:50.939484    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c\": container with ID starting with 8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c not found: ID does not exist" containerID="8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c"
Jul 31 22:41:50.939627 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.939518    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c"} err="failed to get container status \"8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c\": rpc error: code = NotFound desc = could not find container \"8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c\": container with ID starting with 8c9c12422cf5c8734ef27f2a5b7d6c26edea4922d77e26a8c50657f0e11cd65c not found: ID does not exist"
Jul 31 22:41:50.939627 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.939543    2577 scope.go:117] "RemoveContainer" containerID="6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349"
Jul 31 22:41:50.947662 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.947576    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd38caad-be25-438a-8240-68aa45555c37-plugins-config-volume\") pod \"fd38caad-be25-438a-8240-68aa45555c37\" (UID: \"fd38caad-be25-438a-8240-68aa45555c37\") "
Jul 31 22:41:50.947662 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.947633    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a3817cc-3df0-48a7-99af-158b92b1ff44-plugins-config-volume\") pod \"5a3817cc-3df0-48a7-99af-158b92b1ff44\" (UID: \"5a3817cc-3df0-48a7-99af-158b92b1ff44\") "
Jul 31 22:41:50.947793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.947664    2577 scope.go:117] "RemoveContainer" containerID="6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349"
Jul 31 22:41:50.947793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.947667    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmr2d\" (UniqueName: \"kubernetes.io/projected/5a3817cc-3df0-48a7-99af-158b92b1ff44-kube-api-access-vmr2d\") pod \"5a3817cc-3df0-48a7-99af-158b92b1ff44\" (UID: \"5a3817cc-3df0-48a7-99af-158b92b1ff44\") "
Jul 31 22:41:50.948040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.947871    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghpws\" (UniqueName: \"kubernetes.io/projected/fd38caad-be25-438a-8240-68aa45555c37-kube-api-access-ghpws\") pod \"fd38caad-be25-438a-8240-68aa45555c37\" (UID: \"fd38caad-be25-438a-8240-68aa45555c37\") "
Jul 31 22:41:50.948040 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:41:50.947940    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349\": container with ID starting with 6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349 not found: ID does not exist" containerID="6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349"
Jul 31 22:41:50.948040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.947972    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349"} err="failed to get container status \"6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349\": rpc error: code = NotFound desc = could not find container \"6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349\": container with ID starting with 6fac7f07bea5c23bbadd8b33a7511d980fdbd2fe4a56e931f31a925495adb349 not found: ID does not exist"
Jul 31 22:41:50.948040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.947995    2577 scope.go:117] "RemoveContainer" containerID="40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf"
Jul 31 22:41:50.948040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.948007    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd38caad-be25-438a-8240-68aa45555c37-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd38caad-be25-438a-8240-68aa45555c37" (UID: "fd38caad-be25-438a-8240-68aa45555c37"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:41:50.948040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.948020    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a3817cc-3df0-48a7-99af-158b92b1ff44-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a3817cc-3df0-48a7-99af-158b92b1ff44" (UID: "5a3817cc-3df0-48a7-99af-158b92b1ff44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:41:50.948382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.948241    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9adad5dd-77a0-408e-b6db-5f4cfea832d7-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:41:50.948382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.948257    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a3817cc-3df0-48a7-99af-158b92b1ff44-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:41:50.948382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.948265    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ht5s\" (UniqueName: \"kubernetes.io/projected/9adad5dd-77a0-408e-b6db-5f4cfea832d7-kube-api-access-2ht5s\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:41:50.948382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.948275    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9adad5dd-77a0-408e-b6db-5f4cfea832d7-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:41:50.948382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.948283    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd38caad-be25-438a-8240-68aa45555c37-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:41:50.949935 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.949908    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a3817cc-3df0-48a7-99af-158b92b1ff44-kube-api-access-vmr2d" (OuterVolumeSpecName: "kube-api-access-vmr2d") pod "5a3817cc-3df0-48a7-99af-158b92b1ff44" (UID: "5a3817cc-3df0-48a7-99af-158b92b1ff44"). InnerVolumeSpecName "kube-api-access-vmr2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:41:50.950020 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.949969    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd38caad-be25-438a-8240-68aa45555c37-kube-api-access-ghpws" (OuterVolumeSpecName: "kube-api-access-ghpws") pod "fd38caad-be25-438a-8240-68aa45555c37" (UID: "fd38caad-be25-438a-8240-68aa45555c37"). InnerVolumeSpecName "kube-api-access-ghpws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:41:50.954994 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.954973    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"]
Jul 31 22:41:50.956563 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.956540    2577 scope.go:117] "RemoveContainer" containerID="40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf"
Jul 31 22:41:50.956845 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:41:50.956817    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf\": container with ID starting with 40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf not found: ID does not exist" containerID="40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf"
Jul 31 22:41:50.956918 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.956846    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf"} err="failed to get container status \"40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf\": rpc error: code = NotFound desc = could not find container \"40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf\": container with ID starting with 40ff0635d85625c21b999000680d191e48502b0f02f5f0b7ce9f48c225fd16cf not found: ID does not exist"
Jul 31 22:41:50.958376 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:50.958359    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-627bf7-7b76b5dc7d-bbs6p"]
Jul 31 22:41:51.048964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:51.048883    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmr2d\" (UniqueName: \"kubernetes.io/projected/5a3817cc-3df0-48a7-99af-158b92b1ff44-kube-api-access-vmr2d\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:41:51.048964 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:51.048909    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghpws\" (UniqueName: \"kubernetes.io/projected/fd38caad-be25-438a-8240-68aa45555c37-kube-api-access-ghpws\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:41:51.245013 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:51.244985    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"]
Jul 31 22:41:51.248535 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:51.248510    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-627bf7-5665df7f56-524tn"]
Jul 31 22:41:51.258401 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:51.258377    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"]
Jul 31 22:41:51.260524 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:51.260503    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-627bf7-566c749d5d-9jslw"]
Jul 31 22:41:52.532896 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:52.532860    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a3817cc-3df0-48a7-99af-158b92b1ff44" path="/var/lib/kubelet/pods/5a3817cc-3df0-48a7-99af-158b92b1ff44/volumes"
Jul 31 22:41:52.533305 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:52.533291    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9adad5dd-77a0-408e-b6db-5f4cfea832d7" path="/var/lib/kubelet/pods/9adad5dd-77a0-408e-b6db-5f4cfea832d7/volumes"
Jul 31 22:41:52.533616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:41:52.533603    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd38caad-be25-438a-8240-68aa45555c37" path="/var/lib/kubelet/pods/fd38caad-be25-438a-8240-68aa45555c37/volumes"
Jul 31 22:42:01.542053 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.541972    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"]
Jul 31 22:42:01.542487 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.542230    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp" podUID="7c415409-2ad6-48ec-8089-5d3508ff7456" containerName="maas-api" containerID="cri-o://b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5" gracePeriod=30
Jul 31 22:42:01.595384 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.595345    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"]
Jul 31 22:42:01.595644 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.595585    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt" podUID="e6cc0bd1-6edf-415a-ba65-e1255935d889" containerName="payload-processing" containerID="cri-o://bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab" gracePeriod=30
Jul 31 22:42:01.606212 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.605809    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"]
Jul 31 22:42:01.606212 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.606030    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r" podUID="4ec80f25-e4bf-4196-bd36-ae484f569d58" containerName="payload-pre-processing" containerID="cri-o://1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee" gracePeriod=30
Jul 31 22:42:01.865258 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.865228    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:42:01.868714 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.868691    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:42:01.907651 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.907619    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:42:01.993733 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.993698    2577 generic.go:356] "Generic (PLEG): container finished" podID="e6cc0bd1-6edf-415a-ba65-e1255935d889" containerID="bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab" exitCode=0
Jul 31 22:42:01.993907 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.993752    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"
Jul 31 22:42:01.993907 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.993786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt" event={"ID":"e6cc0bd1-6edf-415a-ba65-e1255935d889","Type":"ContainerDied","Data":"bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab"}
Jul 31 22:42:01.993907 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.993848    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt" event={"ID":"e6cc0bd1-6edf-415a-ba65-e1255935d889","Type":"ContainerDied","Data":"3624ac9f1605ebbd24c8b6ada3cb214b6a9603a529608d4132e88edc380f5226"}
Jul 31 22:42:01.993907 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.993879    2577 scope.go:117] "RemoveContainer" containerID="bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab"
Jul 31 22:42:01.995120 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.995102    2577 generic.go:356] "Generic (PLEG): container finished" podID="4ec80f25-e4bf-4196-bd36-ae484f569d58" containerID="1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee" exitCode=0
Jul 31 22:42:01.995236 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.995140    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"
Jul 31 22:42:01.995236 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.995201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r" event={"ID":"4ec80f25-e4bf-4196-bd36-ae484f569d58","Type":"ContainerDied","Data":"1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee"}
Jul 31 22:42:01.995349 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.995253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r" event={"ID":"4ec80f25-e4bf-4196-bd36-ae484f569d58","Type":"ContainerDied","Data":"7e23e7656c1b32b4670293e0c6d7bed7dbc39da05313f8aafb5c130ad49bde65"}
Jul 31 22:42:01.996591 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.996571    2577 generic.go:356] "Generic (PLEG): container finished" podID="7c415409-2ad6-48ec-8089-5d3508ff7456" containerID="b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5" exitCode=0
Jul 31 22:42:01.996712 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.996604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp" event={"ID":"7c415409-2ad6-48ec-8089-5d3508ff7456","Type":"ContainerDied","Data":"b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5"}
Jul 31 22:42:01.996712 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.996614    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"
Jul 31 22:42:01.996712 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:01.996632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp" event={"ID":"7c415409-2ad6-48ec-8089-5d3508ff7456","Type":"ContainerDied","Data":"acdc5697e668e90dd147f4e76ffe8fbea3a1f91d725d3c32ee2f0bc63148780d"}
Jul 31 22:42:02.002944 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.002927    2577 scope.go:117] "RemoveContainer" containerID="bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab"
Jul 31 22:42:02.003249 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:42:02.003224    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab\": container with ID starting with bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab not found: ID does not exist" containerID="bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab"
Jul 31 22:42:02.003310 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.003263    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab"} err="failed to get container status \"bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab\": rpc error: code = NotFound desc = could not find container \"bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab\": container with ID starting with bda071f007f18933a70acdade113ea23865a2c7b40e0657498059a23f53001ab not found: ID does not exist"
Jul 31 22:42:02.003310 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.003294    2577 scope.go:117] "RemoveContainer" containerID="1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee"
Jul 31 22:42:02.011593 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.011563    2577 scope.go:117] "RemoveContainer" containerID="1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee"
Jul 31 22:42:02.011911 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:42:02.011891    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee\": container with ID starting with 1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee not found: ID does not exist" containerID="1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee"
Jul 31 22:42:02.011967 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.011922    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee"} err="failed to get container status \"1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee\": rpc error: code = NotFound desc = could not find container \"1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee\": container with ID starting with 1f759e4a352f5c698c346041c550a33d5b3723006ccda420dc5fe5f8b30e75ee not found: ID does not exist"
Jul 31 22:42:02.011967 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.011943    2577 scope.go:117] "RemoveContainer" containerID="b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5"
Jul 31 22:42:02.020187 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.020156    2577 scope.go:117] "RemoveContainer" containerID="b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5"
Jul 31 22:42:02.020460 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:42:02.020440    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5\": container with ID starting with b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5 not found: ID does not exist" containerID="b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5"
Jul 31 22:42:02.020516 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.020469    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5"} err="failed to get container status \"b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5\": rpc error: code = NotFound desc = could not find container \"b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5\": container with ID starting with b14e7bad47f47bf8044874c491c6d9ba1e1264b3da8ff457e93281b40e75daf5 not found: ID does not exist"
Jul 31 22:42:02.058829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.058742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9cqr\" (UniqueName: \"kubernetes.io/projected/4ec80f25-e4bf-4196-bd36-ae484f569d58-kube-api-access-f9cqr\") pod \"4ec80f25-e4bf-4196-bd36-ae484f569d58\" (UID: \"4ec80f25-e4bf-4196-bd36-ae484f569d58\") "
Jul 31 22:42:02.058829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.058780    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec80f25-e4bf-4196-bd36-ae484f569d58-plugins-config-volume\") pod \"4ec80f25-e4bf-4196-bd36-ae484f569d58\" (UID: \"4ec80f25-e4bf-4196-bd36-ae484f569d58\") "
Jul 31 22:42:02.058829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.058804    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ljmh\" (UniqueName: \"kubernetes.io/projected/e6cc0bd1-6edf-415a-ba65-e1255935d889-kube-api-access-5ljmh\") pod \"e6cc0bd1-6edf-415a-ba65-e1255935d889\" (UID: \"e6cc0bd1-6edf-415a-ba65-e1255935d889\") "
Jul 31 22:42:02.058829 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.058831    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c415409-2ad6-48ec-8089-5d3508ff7456-maas-api-tls\") pod \"7c415409-2ad6-48ec-8089-5d3508ff7456\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") "
Jul 31 22:42:02.059170 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.058880    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6cc0bd1-6edf-415a-ba65-e1255935d889-plugins-config-volume\") pod \"e6cc0bd1-6edf-415a-ba65-e1255935d889\" (UID: \"e6cc0bd1-6edf-415a-ba65-e1255935d889\") "
Jul 31 22:42:02.059170 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.058920    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c415409-2ad6-48ec-8089-5d3508ff7456-openshift-service-ca\") pod \"7c415409-2ad6-48ec-8089-5d3508ff7456\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") "
Jul 31 22:42:02.059170 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.058953    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zp62\" (UniqueName: \"kubernetes.io/projected/7c415409-2ad6-48ec-8089-5d3508ff7456-kube-api-access-6zp62\") pod \"7c415409-2ad6-48ec-8089-5d3508ff7456\" (UID: \"7c415409-2ad6-48ec-8089-5d3508ff7456\") "
Jul 31 22:42:02.059362 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.059306    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6cc0bd1-6edf-415a-ba65-e1255935d889-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e6cc0bd1-6edf-415a-ba65-e1255935d889" (UID: "e6cc0bd1-6edf-415a-ba65-e1255935d889"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:42:02.059362 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.059301    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c415409-2ad6-48ec-8089-5d3508ff7456-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c415409-2ad6-48ec-8089-5d3508ff7456" (UID: "7c415409-2ad6-48ec-8089-5d3508ff7456"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:42:02.059715 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.059688    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec80f25-e4bf-4196-bd36-ae484f569d58-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ec80f25-e4bf-4196-bd36-ae484f569d58" (UID: "4ec80f25-e4bf-4196-bd36-ae484f569d58"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:42:02.061140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.061116    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c415409-2ad6-48ec-8089-5d3508ff7456-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c415409-2ad6-48ec-8089-5d3508ff7456" (UID: "7c415409-2ad6-48ec-8089-5d3508ff7456"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:42:02.061140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.061133    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec80f25-e4bf-4196-bd36-ae484f569d58-kube-api-access-f9cqr" (OuterVolumeSpecName: "kube-api-access-f9cqr") pod "4ec80f25-e4bf-4196-bd36-ae484f569d58" (UID: "4ec80f25-e4bf-4196-bd36-ae484f569d58"). InnerVolumeSpecName "kube-api-access-f9cqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:42:02.061365 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.061349    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6cc0bd1-6edf-415a-ba65-e1255935d889-kube-api-access-5ljmh" (OuterVolumeSpecName: "kube-api-access-5ljmh") pod "e6cc0bd1-6edf-415a-ba65-e1255935d889" (UID: "e6cc0bd1-6edf-415a-ba65-e1255935d889"). InnerVolumeSpecName "kube-api-access-5ljmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:42:02.061438 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.061425    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c415409-2ad6-48ec-8089-5d3508ff7456-kube-api-access-6zp62" (OuterVolumeSpecName: "kube-api-access-6zp62") pod "7c415409-2ad6-48ec-8089-5d3508ff7456" (UID: "7c415409-2ad6-48ec-8089-5d3508ff7456"). InnerVolumeSpecName "kube-api-access-6zp62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:42:02.160160 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.160122    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9cqr\" (UniqueName: \"kubernetes.io/projected/4ec80f25-e4bf-4196-bd36-ae484f569d58-kube-api-access-f9cqr\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:42:02.160160 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.160155    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec80f25-e4bf-4196-bd36-ae484f569d58-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:42:02.160160 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.160164    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ljmh\" (UniqueName: \"kubernetes.io/projected/e6cc0bd1-6edf-415a-ba65-e1255935d889-kube-api-access-5ljmh\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:42:02.160435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.160207    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c415409-2ad6-48ec-8089-5d3508ff7456-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:42:02.160435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.160217    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6cc0bd1-6edf-415a-ba65-e1255935d889-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:42:02.160435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.160225    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c415409-2ad6-48ec-8089-5d3508ff7456-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:42:02.160435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.160234    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zp62\" (UniqueName: \"kubernetes.io/projected/7c415409-2ad6-48ec-8089-5d3508ff7456-kube-api-access-6zp62\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:42:02.319409 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.319320    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"]
Jul 31 22:42:02.326252 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.324945    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-ae5bab-64456f6448-9t48r"]
Jul 31 22:42:02.340522 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.340485    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"]
Jul 31 22:42:02.343403 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.343370    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ae5bab-659467b49b-dqgtt"]
Jul 31 22:42:02.353417 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.353383    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"]
Jul 31 22:42:02.358595 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.358563    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ae5bab-7bd9966645-j66lp"]
Jul 31 22:42:02.533856 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.533811    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ec80f25-e4bf-4196-bd36-ae484f569d58" path="/var/lib/kubelet/pods/4ec80f25-e4bf-4196-bd36-ae484f569d58/volumes"
Jul 31 22:42:02.534312 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.534293    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c415409-2ad6-48ec-8089-5d3508ff7456" path="/var/lib/kubelet/pods/7c415409-2ad6-48ec-8089-5d3508ff7456/volumes"
Jul 31 22:42:02.534689 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:02.534672    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6cc0bd1-6edf-415a-ba65-e1255935d889" path="/var/lib/kubelet/pods/e6cc0bd1-6edf-415a-ba65-e1255935d889/volumes"
Jul 31 22:42:13.710127 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710093    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"]
Jul 31 22:42:13.710517 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710489    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adad5dd-77a0-408e-b6db-5f4cfea832d7" containerName="maas-api"
Jul 31 22:42:13.710517 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710502    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adad5dd-77a0-408e-b6db-5f4cfea832d7" containerName="maas-api"
Jul 31 22:42:13.710517 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710513    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6cc0bd1-6edf-415a-ba65-e1255935d889" containerName="payload-processing"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710520    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6cc0bd1-6edf-415a-ba65-e1255935d889" containerName="payload-processing"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710532    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3817cc-3df0-48a7-99af-158b92b1ff44" containerName="payload-processing"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710537    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3817cc-3df0-48a7-99af-158b92b1ff44" containerName="payload-processing"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710543    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd38caad-be25-438a-8240-68aa45555c37" containerName="payload-pre-processing"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710549    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd38caad-be25-438a-8240-68aa45555c37" containerName="payload-pre-processing"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710561    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c415409-2ad6-48ec-8089-5d3508ff7456" containerName="maas-api"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710566    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c415409-2ad6-48ec-8089-5d3508ff7456" containerName="maas-api"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710577    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec80f25-e4bf-4196-bd36-ae484f569d58" containerName="payload-pre-processing"
Jul 31 22:42:13.710622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710582    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec80f25-e4bf-4196-bd36-ae484f569d58" containerName="payload-pre-processing"
Jul 31 22:42:13.710888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710639    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6cc0bd1-6edf-415a-ba65-e1255935d889" containerName="payload-processing"
Jul 31 22:42:13.710888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710648    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec80f25-e4bf-4196-bd36-ae484f569d58" containerName="payload-pre-processing"
Jul 31 22:42:13.710888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710655    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3817cc-3df0-48a7-99af-158b92b1ff44" containerName="payload-processing"
Jul 31 22:42:13.710888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710661    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9adad5dd-77a0-408e-b6db-5f4cfea832d7" containerName="maas-api"
Jul 31 22:42:13.710888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710669    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd38caad-be25-438a-8240-68aa45555c37" containerName="payload-pre-processing"
Jul 31 22:42:13.710888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.710674    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c415409-2ad6-48ec-8089-5d3508ff7456" containerName="maas-api"
Jul 31 22:42:13.722702 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.722657    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:13.724638 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.724614    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"]
Jul 31 22:42:13.725518 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.725490    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f117f4-serving-cert\""
Jul 31 22:42:13.762996 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.762956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564113cc-add9-4515-b72b-d06317521565-openshift-service-ca\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:13.763171 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.763020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vfkl\" (UniqueName: \"kubernetes.io/projected/564113cc-add9-4515-b72b-d06317521565-kube-api-access-5vfkl\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:13.763171 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.763109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:13.863592 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.863554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:13.863592 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.863594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564113cc-add9-4515-b72b-d06317521565-openshift-service-ca\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:13.863807 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.863657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfkl\" (UniqueName: \"kubernetes.io/projected/564113cc-add9-4515-b72b-d06317521565-kube-api-access-5vfkl\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:13.863807 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:42:13.863714    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-serving-cert: secret "maas-api-e2e-api-a-f117f4-serving-cert" not found
Jul 31 22:42:13.863807 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:42:13.863801    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls podName:564113cc-add9-4515-b72b-d06317521565 nodeName:}" failed. No retries permitted until 2026-07-31 22:42:14.363778533 +0000 UTC m=+2526.316864761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls") pod "maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp" (UID: "564113cc-add9-4515-b72b-d06317521565") : secret "maas-api-e2e-api-a-f117f4-serving-cert" not found
Jul 31 22:42:13.864325 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.864305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564113cc-add9-4515-b72b-d06317521565-openshift-service-ca\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:13.875564 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:13.875542    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfkl\" (UniqueName: \"kubernetes.io/projected/564113cc-add9-4515-b72b-d06317521565-kube-api-access-5vfkl\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:14.366660 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.366620    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"]
Jul 31 22:42:14.368545 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.368522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:14.370468 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.370429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:14.371254 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.371230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls\") pod \"maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:14.372712 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.372694    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-f117f4\""
Jul 31 22:42:14.381636 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.381604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"]
Jul 31 22:42:14.385457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.385429    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"]
Jul 31 22:42:14.389579 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.389553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:14.392405 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.392385    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-f117f4-dockercfg-k69xl\""
Jul 31 22:42:14.401152 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.401130    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"]
Jul 31 22:42:14.469483 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.469447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph8v4\" (UniqueName: \"kubernetes.io/projected/92ae854e-e6dc-44da-b26f-40e5a100f212-kube-api-access-ph8v4\") pod \"payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg\" (UID: \"92ae854e-e6dc-44da-b26f-40e5a100f212\") " pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:14.469666 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.469520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt\" (UID: \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:14.469666 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.469549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pscqr\" (UniqueName: \"kubernetes.io/projected/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-kube-api-access-pscqr\") pod \"payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt\" (UID: \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:14.469666 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.469576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ae854e-e6dc-44da-b26f-40e5a100f212-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg\" (UID: \"92ae854e-e6dc-44da-b26f-40e5a100f212\") " pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:14.570532 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.570496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt\" (UID: \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:14.570532 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.570545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pscqr\" (UniqueName: \"kubernetes.io/projected/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-kube-api-access-pscqr\") pod \"payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt\" (UID: \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:14.570772 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.570680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ae854e-e6dc-44da-b26f-40e5a100f212-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg\" (UID: \"92ae854e-e6dc-44da-b26f-40e5a100f212\") " pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:14.570889 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.570776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph8v4\" (UniqueName: \"kubernetes.io/projected/92ae854e-e6dc-44da-b26f-40e5a100f212-kube-api-access-ph8v4\") pod \"payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg\" (UID: \"92ae854e-e6dc-44da-b26f-40e5a100f212\") " pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:14.571296 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.571263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt\" (UID: \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:14.571500 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.571481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ae854e-e6dc-44da-b26f-40e5a100f212-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg\" (UID: \"92ae854e-e6dc-44da-b26f-40e5a100f212\") " pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:14.579461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.579435    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscqr\" (UniqueName: \"kubernetes.io/projected/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-kube-api-access-pscqr\") pod \"payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt\" (UID: \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:14.579545 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.579496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph8v4\" (UniqueName: \"kubernetes.io/projected/92ae854e-e6dc-44da-b26f-40e5a100f212-kube-api-access-ph8v4\") pod \"payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg\" (UID: \"92ae854e-e6dc-44da-b26f-40e5a100f212\") " pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:14.635091 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.635001    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:14.692163 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.692130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:14.701984 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.701949    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:14.816015 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.815733    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"]
Jul 31 22:42:14.819589 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:42:14.819559    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564113cc_add9_4515_b72b_d06317521565.slice/crio-aa3e4e5768d45ed4247f36649be439f56331fdcefa9bd8ec91ac7a5c062cd7b7 WatchSource:0}: Error finding container aa3e4e5768d45ed4247f36649be439f56331fdcefa9bd8ec91ac7a5c062cd7b7: Status 404 returned error can't find the container with id aa3e4e5768d45ed4247f36649be439f56331fdcefa9bd8ec91ac7a5c062cd7b7
Jul 31 22:42:14.821039 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.821015    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:42:14.890196 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.889860    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"]
Jul 31 22:42:14.892152 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:42:14.892122    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda848c7f0_5b5b_4d2e_a00f_37e0a74ab796.slice/crio-a341288b033b0bbb7004939ea904ef0dd1dfd91bbb628ea8438461c660f14998 WatchSource:0}: Error finding container a341288b033b0bbb7004939ea904ef0dd1dfd91bbb628ea8438461c660f14998: Status 404 returned error can't find the container with id a341288b033b0bbb7004939ea904ef0dd1dfd91bbb628ea8438461c660f14998
Jul 31 22:42:14.915888 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:14.915858    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"]
Jul 31 22:42:14.917998 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:42:14.917967    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ae854e_e6dc_44da_b26f_40e5a100f212.slice/crio-0637a419fa2b20d794fae07882a6c9138a45f84afed2558bd9ed16aa86892f16 WatchSource:0}: Error finding container 0637a419fa2b20d794fae07882a6c9138a45f84afed2558bd9ed16aa86892f16: Status 404 returned error can't find the container with id 0637a419fa2b20d794fae07882a6c9138a45f84afed2558bd9ed16aa86892f16
Jul 31 22:42:15.071983 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.071944    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt" event={"ID":"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796","Type":"ContainerStarted","Data":"513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2"}
Jul 31 22:42:15.072224 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.072012    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:15.072224 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.072037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt" event={"ID":"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796","Type":"ContainerStarted","Data":"a341288b033b0bbb7004939ea904ef0dd1dfd91bbb628ea8438461c660f14998"}
Jul 31 22:42:15.073445 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.073420    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp" event={"ID":"564113cc-add9-4515-b72b-d06317521565","Type":"ContainerStarted","Data":"aa3e4e5768d45ed4247f36649be439f56331fdcefa9bd8ec91ac7a5c062cd7b7"}
Jul 31 22:42:15.075137 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.075112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg" event={"ID":"92ae854e-e6dc-44da-b26f-40e5a100f212","Type":"ContainerStarted","Data":"c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7"}
Jul 31 22:42:15.075279 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.075161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg" event={"ID":"92ae854e-e6dc-44da-b26f-40e5a100f212","Type":"ContainerStarted","Data":"0637a419fa2b20d794fae07882a6c9138a45f84afed2558bd9ed16aa86892f16"}
Jul 31 22:42:15.075279 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.075240    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:15.090672 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.090606    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt" podStartSLOduration=1.09058507 podStartE2EDuration="1.09058507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:42:15.086952757 +0000 UTC m=+2527.040038986" watchObservedRunningTime="2026-07-31 22:42:15.09058507 +0000 UTC m=+2527.043671300"
Jul 31 22:42:15.102567 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:15.102492    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg" podStartSLOduration=1.102474775 podStartE2EDuration="1.102474775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:42:15.101464396 +0000 UTC m=+2527.054550629" watchObservedRunningTime="2026-07-31 22:42:15.102474775 +0000 UTC m=+2527.055561066"
Jul 31 22:42:16.082583 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:16.082535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp" event={"ID":"564113cc-add9-4515-b72b-d06317521565","Type":"ContainerStarted","Data":"4845b1ed6361e62d4d6ac12a64cd2b88adeae0c8866db410fb77ccb30d5b7606"}
Jul 31 22:42:16.083072 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:16.082830    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:16.099161 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:16.099108    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp" podStartSLOduration=2.531552285 podStartE2EDuration="3.099091921s" totalImagesPullingTime="567.539636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:42:16.097904128 +0000 UTC m=+2528.050990348" watchObservedRunningTime="2026-07-31 22:42:16.099091921 +0000 UTC m=+2528.052178150"
Jul 31 22:42:22.095015 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:22.094984    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:42:26.084292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:26.084254    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:42:26.084689 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:26.084335    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:42:42.867884 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:42.867849    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"]
Jul 31 22:42:42.871916 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:42.871892    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:42.874269 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:42.874244    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-84098f-serving-cert\""
Jul 31 22:42:42.882670 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:42.882645    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"]
Jul 31 22:42:42.958486 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:42.958445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxc89\" (UniqueName: \"kubernetes.io/projected/7319475e-b2bc-443e-8bab-7c83b6f74fa1-kube-api-access-wxc89\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:42.958486 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:42.958488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7319475e-b2bc-443e-8bab-7c83b6f74fa1-openshift-service-ca\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:42.958746 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:42.958578    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7319475e-b2bc-443e-8bab-7c83b6f74fa1-maas-api-tls\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:43.059683 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.059645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7319475e-b2bc-443e-8bab-7c83b6f74fa1-maas-api-tls\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:43.059869 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.059743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxc89\" (UniqueName: \"kubernetes.io/projected/7319475e-b2bc-443e-8bab-7c83b6f74fa1-kube-api-access-wxc89\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:43.059869 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.059790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7319475e-b2bc-443e-8bab-7c83b6f74fa1-openshift-service-ca\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:43.060435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.060411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7319475e-b2bc-443e-8bab-7c83b6f74fa1-openshift-service-ca\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:43.062035 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.062015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7319475e-b2bc-443e-8bab-7c83b6f74fa1-maas-api-tls\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:43.068083 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.068063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxc89\" (UniqueName: \"kubernetes.io/projected/7319475e-b2bc-443e-8bab-7c83b6f74fa1-kube-api-access-wxc89\") pod \"maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:43.185347 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.185250    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:43.347798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.347770    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"]
Jul 31 22:42:43.350305 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:42:43.350276    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7319475e_b2bc_443e_8bab_7c83b6f74fa1.slice/crio-ac54adfef334daf6446f5b7a44295b1e90acb0460a7b36fe309b7842fdde6fbb WatchSource:0}: Error finding container ac54adfef334daf6446f5b7a44295b1e90acb0460a7b36fe309b7842fdde6fbb: Status 404 returned error can't find the container with id ac54adfef334daf6446f5b7a44295b1e90acb0460a7b36fe309b7842fdde6fbb
Jul 31 22:42:43.782492 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.782465    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"]
Jul 31 22:42:43.787017 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.786997    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:43.793896 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.791854    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-84098f\""
Jul 31 22:42:43.819155 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.819126    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"]
Jul 31 22:42:43.821938 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.821908    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"]
Jul 31 22:42:43.826916 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.826896    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:43.829934 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.829914    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-84098f-dockercfg-8wq2n\""
Jul 31 22:42:43.852190 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.852146    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"]
Jul 31 22:42:43.866592 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.866560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24335777-013b-477c-99c3-c460b44510cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n\" (UID: \"24335777-013b-477c-99c3-c460b44510cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:43.866759 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.866618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1158b51-de88-4412-98e2-f048d2e1dc01-plugins-config-volume\") pod \"payload-processing-e2e-api-b-84098f-858db75d8d-p654h\" (UID: \"f1158b51-de88-4412-98e2-f048d2e1dc01\") " pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:43.866759 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.866635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdwq\" (UniqueName: \"kubernetes.io/projected/f1158b51-de88-4412-98e2-f048d2e1dc01-kube-api-access-lkdwq\") pod \"payload-processing-e2e-api-b-84098f-858db75d8d-p654h\" (UID: \"f1158b51-de88-4412-98e2-f048d2e1dc01\") " pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:43.866948 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.866782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv8h9\" (UniqueName: \"kubernetes.io/projected/24335777-013b-477c-99c3-c460b44510cc-kube-api-access-rv8h9\") pod \"payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n\" (UID: \"24335777-013b-477c-99c3-c460b44510cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:43.967550 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.967504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv8h9\" (UniqueName: \"kubernetes.io/projected/24335777-013b-477c-99c3-c460b44510cc-kube-api-access-rv8h9\") pod \"payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n\" (UID: \"24335777-013b-477c-99c3-c460b44510cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:43.968055 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.967570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24335777-013b-477c-99c3-c460b44510cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n\" (UID: \"24335777-013b-477c-99c3-c460b44510cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:43.968055 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.967603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1158b51-de88-4412-98e2-f048d2e1dc01-plugins-config-volume\") pod \"payload-processing-e2e-api-b-84098f-858db75d8d-p654h\" (UID: \"f1158b51-de88-4412-98e2-f048d2e1dc01\") " pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:43.968055 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.967621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdwq\" (UniqueName: \"kubernetes.io/projected/f1158b51-de88-4412-98e2-f048d2e1dc01-kube-api-access-lkdwq\") pod \"payload-processing-e2e-api-b-84098f-858db75d8d-p654h\" (UID: \"f1158b51-de88-4412-98e2-f048d2e1dc01\") " pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:43.968396 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.968375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1158b51-de88-4412-98e2-f048d2e1dc01-plugins-config-volume\") pod \"payload-processing-e2e-api-b-84098f-858db75d8d-p654h\" (UID: \"f1158b51-de88-4412-98e2-f048d2e1dc01\") " pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:43.968482 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.968408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24335777-013b-477c-99c3-c460b44510cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n\" (UID: \"24335777-013b-477c-99c3-c460b44510cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:43.978871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.978847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv8h9\" (UniqueName: \"kubernetes.io/projected/24335777-013b-477c-99c3-c460b44510cc-kube-api-access-rv8h9\") pod \"payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n\" (UID: \"24335777-013b-477c-99c3-c460b44510cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:43.987736 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:43.987715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdwq\" (UniqueName: \"kubernetes.io/projected/f1158b51-de88-4412-98e2-f048d2e1dc01-kube-api-access-lkdwq\") pod \"payload-processing-e2e-api-b-84098f-858db75d8d-p654h\" (UID: \"f1158b51-de88-4412-98e2-f048d2e1dc01\") " pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:44.102220 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:44.102159    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:44.144317 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:44.144282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:44.238633 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:44.238592    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp" event={"ID":"7319475e-b2bc-443e-8bab-7c83b6f74fa1","Type":"ContainerStarted","Data":"15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311"}
Jul 31 22:42:44.238819 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:44.238657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp" event={"ID":"7319475e-b2bc-443e-8bab-7c83b6f74fa1","Type":"ContainerStarted","Data":"ac54adfef334daf6446f5b7a44295b1e90acb0460a7b36fe309b7842fdde6fbb"}
Jul 31 22:42:44.238819 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:44.238730    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:44.255565 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:44.255533    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"]
Jul 31 22:42:44.257368 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:44.257297    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp" podStartSLOduration=1.826832387 podStartE2EDuration="2.257277081s" totalImagesPullingTime="430.444694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:42:44.254530055 +0000 UTC m=+2556.207616283" watchObservedRunningTime="2026-07-31 22:42:44.257277081 +0000 UTC m=+2556.210363310"
Jul 31 22:42:44.258071 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:42:44.258028    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24335777_013b_477c_99c3_c460b44510cc.slice/crio-d26c811a000c774cdb6290b136c7ecf92b2cef1d47d6fa253b451f7863951b61 WatchSource:0}: Error finding container d26c811a000c774cdb6290b136c7ecf92b2cef1d47d6fa253b451f7863951b61: Status 404 returned error can't find the container with id d26c811a000c774cdb6290b136c7ecf92b2cef1d47d6fa253b451f7863951b61
Jul 31 22:42:44.309703 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:44.309676    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"]
Jul 31 22:42:44.311934 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:42:44.311906    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1158b51_de88_4412_98e2_f048d2e1dc01.slice/crio-3c62c69af4d2f037c509456316ae3d005b2a7ed329611e8b36ccfd63b926a15a WatchSource:0}: Error finding container 3c62c69af4d2f037c509456316ae3d005b2a7ed329611e8b36ccfd63b926a15a: Status 404 returned error can't find the container with id 3c62c69af4d2f037c509456316ae3d005b2a7ed329611e8b36ccfd63b926a15a
Jul 31 22:42:45.245116 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:45.245078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n" event={"ID":"24335777-013b-477c-99c3-c460b44510cc","Type":"ContainerStarted","Data":"65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61"}
Jul 31 22:42:45.245652 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:45.245144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n" event={"ID":"24335777-013b-477c-99c3-c460b44510cc","Type":"ContainerStarted","Data":"d26c811a000c774cdb6290b136c7ecf92b2cef1d47d6fa253b451f7863951b61"}
Jul 31 22:42:45.245652 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:45.245200    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:45.246931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:45.246900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h" event={"ID":"f1158b51-de88-4412-98e2-f048d2e1dc01","Type":"ContainerStarted","Data":"292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae"}
Jul 31 22:42:45.247157 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:45.247137    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:42:45.247247 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:45.247193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h" event={"ID":"f1158b51-de88-4412-98e2-f048d2e1dc01","Type":"ContainerStarted","Data":"3c62c69af4d2f037c509456316ae3d005b2a7ed329611e8b36ccfd63b926a15a"}
Jul 31 22:42:45.263044 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:45.262999    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n" podStartSLOduration=2.262985172 podStartE2EDuration="2.262985172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:42:45.259760096 +0000 UTC m=+2557.212846326" watchObservedRunningTime="2026-07-31 22:42:45.262985172 +0000 UTC m=+2557.216071400"
Jul 31 22:42:45.277630 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:45.277576    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h" podStartSLOduration=2.277558355 podStartE2EDuration="2.277558355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:42:45.276191421 +0000 UTC m=+2557.229277652" watchObservedRunningTime="2026-07-31 22:42:45.277558355 +0000 UTC m=+2557.230644586"
Jul 31 22:42:50.252540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:50.252511    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:42:56.256118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:56.256089    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:42:56.256628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:42:56.256238    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:43:25.351620 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.351557    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"]
Jul 31 22:43:25.352492 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.352432    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp" podUID="564113cc-add9-4515-b72b-d06317521565" containerName="maas-api" containerID="cri-o://4845b1ed6361e62d4d6ac12a64cd2b88adeae0c8866db410fb77ccb30d5b7606" gracePeriod=30
Jul 31 22:43:25.408344 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.408308    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"]
Jul 31 22:43:25.408614 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.408586    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg" podUID="92ae854e-e6dc-44da-b26f-40e5a100f212" containerName="payload-processing" containerID="cri-o://c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7" gracePeriod=30
Jul 31 22:43:25.414929 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.414898    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"]
Jul 31 22:43:25.415447 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.415112    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt" podUID="a848c7f0-5b5b-4d2e-a00f-37e0a74ab796" containerName="payload-pre-processing" containerID="cri-o://513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2" gracePeriod=30
Jul 31 22:43:25.481452 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.481422    2577 generic.go:356] "Generic (PLEG): container finished" podID="564113cc-add9-4515-b72b-d06317521565" containerID="4845b1ed6361e62d4d6ac12a64cd2b88adeae0c8866db410fb77ccb30d5b7606" exitCode=0
Jul 31 22:43:25.481611 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.481497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp" event={"ID":"564113cc-add9-4515-b72b-d06317521565","Type":"ContainerDied","Data":"4845b1ed6361e62d4d6ac12a64cd2b88adeae0c8866db410fb77ccb30d5b7606"}
Jul 31 22:43:25.678306 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.678280    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:43:25.701215 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.701161    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:43:25.741987 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.741962    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:43:25.761343 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.761309    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ae854e-e6dc-44da-b26f-40e5a100f212-plugins-config-volume\") pod \"92ae854e-e6dc-44da-b26f-40e5a100f212\" (UID: \"92ae854e-e6dc-44da-b26f-40e5a100f212\") "
Jul 31 22:43:25.761541 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.761426    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vfkl\" (UniqueName: \"kubernetes.io/projected/564113cc-add9-4515-b72b-d06317521565-kube-api-access-5vfkl\") pod \"564113cc-add9-4515-b72b-d06317521565\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") "
Jul 31 22:43:25.761541 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.761455    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pscqr\" (UniqueName: \"kubernetes.io/projected/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-kube-api-access-pscqr\") pod \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\" (UID: \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\") "
Jul 31 22:43:25.761541 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.761503    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls\") pod \"564113cc-add9-4515-b72b-d06317521565\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") "
Jul 31 22:43:25.761728 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.761547    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph8v4\" (UniqueName: \"kubernetes.io/projected/92ae854e-e6dc-44da-b26f-40e5a100f212-kube-api-access-ph8v4\") pod \"92ae854e-e6dc-44da-b26f-40e5a100f212\" (UID: \"92ae854e-e6dc-44da-b26f-40e5a100f212\") "
Jul 31 22:43:25.761728 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.761578    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-plugins-config-volume\") pod \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\" (UID: \"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796\") "
Jul 31 22:43:25.761728 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.761629    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564113cc-add9-4515-b72b-d06317521565-openshift-service-ca\") pod \"564113cc-add9-4515-b72b-d06317521565\" (UID: \"564113cc-add9-4515-b72b-d06317521565\") "
Jul 31 22:43:25.762580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.762477    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/564113cc-add9-4515-b72b-d06317521565-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "564113cc-add9-4515-b72b-d06317521565" (UID: "564113cc-add9-4515-b72b-d06317521565"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:43:25.762580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.762540    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a848c7f0-5b5b-4d2e-a00f-37e0a74ab796" (UID: "a848c7f0-5b5b-4d2e-a00f-37e0a74ab796"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:43:25.762769 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.762591    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92ae854e-e6dc-44da-b26f-40e5a100f212-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92ae854e-e6dc-44da-b26f-40e5a100f212" (UID: "92ae854e-e6dc-44da-b26f-40e5a100f212"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:43:25.764424 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.764400    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-kube-api-access-pscqr" (OuterVolumeSpecName: "kube-api-access-pscqr") pod "a848c7f0-5b5b-4d2e-a00f-37e0a74ab796" (UID: "a848c7f0-5b5b-4d2e-a00f-37e0a74ab796"). InnerVolumeSpecName "kube-api-access-pscqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:43:25.764623 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.764606    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/564113cc-add9-4515-b72b-d06317521565-kube-api-access-5vfkl" (OuterVolumeSpecName: "kube-api-access-5vfkl") pod "564113cc-add9-4515-b72b-d06317521565" (UID: "564113cc-add9-4515-b72b-d06317521565"). InnerVolumeSpecName "kube-api-access-5vfkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:43:25.765051 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.765025    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "564113cc-add9-4515-b72b-d06317521565" (UID: "564113cc-add9-4515-b72b-d06317521565"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:43:25.765416 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.765394    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92ae854e-e6dc-44da-b26f-40e5a100f212-kube-api-access-ph8v4" (OuterVolumeSpecName: "kube-api-access-ph8v4") pod "92ae854e-e6dc-44da-b26f-40e5a100f212" (UID: "92ae854e-e6dc-44da-b26f-40e5a100f212"). InnerVolumeSpecName "kube-api-access-ph8v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:43:25.862648 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.862612    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/564113cc-add9-4515-b72b-d06317521565-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:25.862648 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.862644    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph8v4\" (UniqueName: \"kubernetes.io/projected/92ae854e-e6dc-44da-b26f-40e5a100f212-kube-api-access-ph8v4\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:25.862648 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.862654    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:25.862895 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.862664    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/564113cc-add9-4515-b72b-d06317521565-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:25.862895 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.862673    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92ae854e-e6dc-44da-b26f-40e5a100f212-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:25.862895 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.862681    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vfkl\" (UniqueName: \"kubernetes.io/projected/564113cc-add9-4515-b72b-d06317521565-kube-api-access-5vfkl\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:25.862895 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:25.862689    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pscqr\" (UniqueName: \"kubernetes.io/projected/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796-kube-api-access-pscqr\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:26.496540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.496501    2577 generic.go:356] "Generic (PLEG): container finished" podID="92ae854e-e6dc-44da-b26f-40e5a100f212" containerID="c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7" exitCode=0
Jul 31 22:43:26.496977 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.496559    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"
Jul 31 22:43:26.496977 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.496584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg" event={"ID":"92ae854e-e6dc-44da-b26f-40e5a100f212","Type":"ContainerDied","Data":"c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7"}
Jul 31 22:43:26.496977 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.496667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg" event={"ID":"92ae854e-e6dc-44da-b26f-40e5a100f212","Type":"ContainerDied","Data":"0637a419fa2b20d794fae07882a6c9138a45f84afed2558bd9ed16aa86892f16"}
Jul 31 22:43:26.496977 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.496700    2577 scope.go:117] "RemoveContainer" containerID="c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7"
Jul 31 22:43:26.497986 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.497967    2577 generic.go:356] "Generic (PLEG): container finished" podID="a848c7f0-5b5b-4d2e-a00f-37e0a74ab796" containerID="513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2" exitCode=0
Jul 31 22:43:26.498071 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.498025    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"
Jul 31 22:43:26.498071 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.498055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt" event={"ID":"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796","Type":"ContainerDied","Data":"513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2"}
Jul 31 22:43:26.498206 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.498106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt" event={"ID":"a848c7f0-5b5b-4d2e-a00f-37e0a74ab796","Type":"ContainerDied","Data":"a341288b033b0bbb7004939ea904ef0dd1dfd91bbb628ea8438461c660f14998"}
Jul 31 22:43:26.499654 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.499629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp" event={"ID":"564113cc-add9-4515-b72b-d06317521565","Type":"ContainerDied","Data":"aa3e4e5768d45ed4247f36649be439f56331fdcefa9bd8ec91ac7a5c062cd7b7"}
Jul 31 22:43:26.499777 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.499655    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"
Jul 31 22:43:26.507344 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.507325    2577 scope.go:117] "RemoveContainer" containerID="c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7"
Jul 31 22:43:26.507614 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:43:26.507591    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7\": container with ID starting with c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7 not found: ID does not exist" containerID="c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7"
Jul 31 22:43:26.507709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.507620    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7"} err="failed to get container status \"c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7\": rpc error: code = NotFound desc = could not find container \"c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7\": container with ID starting with c9cf97d7494f06bf63a1090f5722b9f1dd0377dd003c54d58d2414197d8a53f7 not found: ID does not exist"
Jul 31 22:43:26.507709 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.507636    2577 scope.go:117] "RemoveContainer" containerID="513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2"
Jul 31 22:43:26.516215 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.516196    2577 scope.go:117] "RemoveContainer" containerID="513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2"
Jul 31 22:43:26.516479 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:43:26.516460    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2\": container with ID starting with 513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2 not found: ID does not exist" containerID="513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2"
Jul 31 22:43:26.516557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.516488    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2"} err="failed to get container status \"513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2\": rpc error: code = NotFound desc = could not find container \"513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2\": container with ID starting with 513b16a66334b657ba9940230a2e807b543babc7172b44e610459a83e8db96a2 not found: ID does not exist"
Jul 31 22:43:26.516557 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.516510    2577 scope.go:117] "RemoveContainer" containerID="4845b1ed6361e62d4d6ac12a64cd2b88adeae0c8866db410fb77ccb30d5b7606"
Jul 31 22:43:26.523686 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.523659    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"]
Jul 31 22:43:26.533166 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.533136    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f117f4-5588cdd9d6-6zjlg"]
Jul 31 22:43:26.542629 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.542604    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"]
Jul 31 22:43:26.546771 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.546747    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f117f4-665876dd9b-h6txt"]
Jul 31 22:43:26.557342 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.557318    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"]
Jul 31 22:43:26.561207 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:26.561163    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f117f4-6c6d6df59d-n58rp"]
Jul 31 22:43:28.532198 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:28.532145    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="564113cc-add9-4515-b72b-d06317521565" path="/var/lib/kubelet/pods/564113cc-add9-4515-b72b-d06317521565/volumes"
Jul 31 22:43:28.532740 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:28.532718    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92ae854e-e6dc-44da-b26f-40e5a100f212" path="/var/lib/kubelet/pods/92ae854e-e6dc-44da-b26f-40e5a100f212/volumes"
Jul 31 22:43:28.533107 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:28.533088    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a848c7f0-5b5b-4d2e-a00f-37e0a74ab796" path="/var/lib/kubelet/pods/a848c7f0-5b5b-4d2e-a00f-37e0a74ab796/volumes"
Jul 31 22:43:48.051341 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.051304    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"]
Jul 31 22:43:48.051721 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.051509    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp" podUID="7319475e-b2bc-443e-8bab-7c83b6f74fa1" containerName="maas-api" containerID="cri-o://15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311" gracePeriod=30
Jul 31 22:43:48.101719 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.101688    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"]
Jul 31 22:43:48.101936 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.101895    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h" podUID="f1158b51-de88-4412-98e2-f048d2e1dc01" containerName="payload-processing" containerID="cri-o://292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae" gracePeriod=30
Jul 31 22:43:48.111323 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.111288    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"]
Jul 31 22:43:48.111540 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.111498    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n" podUID="24335777-013b-477c-99c3-c460b44510cc" containerName="payload-pre-processing" containerID="cri-o://65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61" gracePeriod=30
Jul 31 22:43:48.404198 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.403577    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:43:48.417606 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.417582    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:43:48.432060 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.432034    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:43:48.475976 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.475945    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7319475e-b2bc-443e-8bab-7c83b6f74fa1-maas-api-tls\") pod \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") "
Jul 31 22:43:48.476118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.475991    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1158b51-de88-4412-98e2-f048d2e1dc01-plugins-config-volume\") pod \"f1158b51-de88-4412-98e2-f048d2e1dc01\" (UID: \"f1158b51-de88-4412-98e2-f048d2e1dc01\") "
Jul 31 22:43:48.476118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.476012    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7319475e-b2bc-443e-8bab-7c83b6f74fa1-openshift-service-ca\") pod \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") "
Jul 31 22:43:48.476118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.476060    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkdwq\" (UniqueName: \"kubernetes.io/projected/f1158b51-de88-4412-98e2-f048d2e1dc01-kube-api-access-lkdwq\") pod \"f1158b51-de88-4412-98e2-f048d2e1dc01\" (UID: \"f1158b51-de88-4412-98e2-f048d2e1dc01\") "
Jul 31 22:43:48.476332 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.476205    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxc89\" (UniqueName: \"kubernetes.io/projected/7319475e-b2bc-443e-8bab-7c83b6f74fa1-kube-api-access-wxc89\") pod \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\" (UID: \"7319475e-b2bc-443e-8bab-7c83b6f74fa1\") "
Jul 31 22:43:48.476393 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.476359    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7319475e-b2bc-443e-8bab-7c83b6f74fa1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7319475e-b2bc-443e-8bab-7c83b6f74fa1" (UID: "7319475e-b2bc-443e-8bab-7c83b6f74fa1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:43:48.476449 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.476396    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1158b51-de88-4412-98e2-f048d2e1dc01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f1158b51-de88-4412-98e2-f048d2e1dc01" (UID: "f1158b51-de88-4412-98e2-f048d2e1dc01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:43:48.476560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.476535    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1158b51-de88-4412-98e2-f048d2e1dc01-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:48.476560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.476558    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7319475e-b2bc-443e-8bab-7c83b6f74fa1-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:48.478235 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.478206    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1158b51-de88-4412-98e2-f048d2e1dc01-kube-api-access-lkdwq" (OuterVolumeSpecName: "kube-api-access-lkdwq") pod "f1158b51-de88-4412-98e2-f048d2e1dc01" (UID: "f1158b51-de88-4412-98e2-f048d2e1dc01"). InnerVolumeSpecName "kube-api-access-lkdwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:43:48.478322 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.478250    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7319475e-b2bc-443e-8bab-7c83b6f74fa1-kube-api-access-wxc89" (OuterVolumeSpecName: "kube-api-access-wxc89") pod "7319475e-b2bc-443e-8bab-7c83b6f74fa1" (UID: "7319475e-b2bc-443e-8bab-7c83b6f74fa1"). InnerVolumeSpecName "kube-api-access-wxc89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:43:48.478322 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.478259    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7319475e-b2bc-443e-8bab-7c83b6f74fa1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7319475e-b2bc-443e-8bab-7c83b6f74fa1" (UID: "7319475e-b2bc-443e-8bab-7c83b6f74fa1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:43:48.577192 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.577103    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv8h9\" (UniqueName: \"kubernetes.io/projected/24335777-013b-477c-99c3-c460b44510cc-kube-api-access-rv8h9\") pod \"24335777-013b-477c-99c3-c460b44510cc\" (UID: \"24335777-013b-477c-99c3-c460b44510cc\") "
Jul 31 22:43:48.577333 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.577230    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24335777-013b-477c-99c3-c460b44510cc-plugins-config-volume\") pod \"24335777-013b-477c-99c3-c460b44510cc\" (UID: \"24335777-013b-477c-99c3-c460b44510cc\") "
Jul 31 22:43:48.577480 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.577461    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxc89\" (UniqueName: \"kubernetes.io/projected/7319475e-b2bc-443e-8bab-7c83b6f74fa1-kube-api-access-wxc89\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:48.577547 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.577485    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7319475e-b2bc-443e-8bab-7c83b6f74fa1-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:48.577547 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.577503    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkdwq\" (UniqueName: \"kubernetes.io/projected/f1158b51-de88-4412-98e2-f048d2e1dc01-kube-api-access-lkdwq\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:48.577624 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.577600    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24335777-013b-477c-99c3-c460b44510cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "24335777-013b-477c-99c3-c460b44510cc" (UID: "24335777-013b-477c-99c3-c460b44510cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:43:48.579197 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.579163    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24335777-013b-477c-99c3-c460b44510cc-kube-api-access-rv8h9" (OuterVolumeSpecName: "kube-api-access-rv8h9") pod "24335777-013b-477c-99c3-c460b44510cc" (UID: "24335777-013b-477c-99c3-c460b44510cc"). InnerVolumeSpecName "kube-api-access-rv8h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:43:48.626511 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.626478    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1158b51-de88-4412-98e2-f048d2e1dc01" containerID="292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae" exitCode=0
Jul 31 22:43:48.626683 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.626525    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"
Jul 31 22:43:48.626683 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.626549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h" event={"ID":"f1158b51-de88-4412-98e2-f048d2e1dc01","Type":"ContainerDied","Data":"292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae"}
Jul 31 22:43:48.626683 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.626598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h" event={"ID":"f1158b51-de88-4412-98e2-f048d2e1dc01","Type":"ContainerDied","Data":"3c62c69af4d2f037c509456316ae3d005b2a7ed329611e8b36ccfd63b926a15a"}
Jul 31 22:43:48.626683 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.626621    2577 scope.go:117] "RemoveContainer" containerID="292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae"
Jul 31 22:43:48.627919 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.627896    2577 generic.go:356] "Generic (PLEG): container finished" podID="7319475e-b2bc-443e-8bab-7c83b6f74fa1" containerID="15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311" exitCode=0
Jul 31 22:43:48.628012 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.627935    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"
Jul 31 22:43:48.628065 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.628023    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp" event={"ID":"7319475e-b2bc-443e-8bab-7c83b6f74fa1","Type":"ContainerDied","Data":"15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311"}
Jul 31 22:43:48.628127 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.628102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp" event={"ID":"7319475e-b2bc-443e-8bab-7c83b6f74fa1","Type":"ContainerDied","Data":"ac54adfef334daf6446f5b7a44295b1e90acb0460a7b36fe309b7842fdde6fbb"}
Jul 31 22:43:48.629538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.629502    2577 generic.go:356] "Generic (PLEG): container finished" podID="24335777-013b-477c-99c3-c460b44510cc" containerID="65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61" exitCode=0
Jul 31 22:43:48.629657 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.629532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n" event={"ID":"24335777-013b-477c-99c3-c460b44510cc","Type":"ContainerDied","Data":"65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61"}
Jul 31 22:43:48.629657 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.629558    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"
Jul 31 22:43:48.629657 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.629581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n" event={"ID":"24335777-013b-477c-99c3-c460b44510cc","Type":"ContainerDied","Data":"d26c811a000c774cdb6290b136c7ecf92b2cef1d47d6fa253b451f7863951b61"}
Jul 31 22:43:48.638461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.636953    2577 scope.go:117] "RemoveContainer" containerID="292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae"
Jul 31 22:43:48.638461 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:43:48.637294    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae\": container with ID starting with 292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae not found: ID does not exist" containerID="292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae"
Jul 31 22:43:48.638461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.637329    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae"} err="failed to get container status \"292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae\": rpc error: code = NotFound desc = could not find container \"292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae\": container with ID starting with 292f4d14dbd81577c91757909a7386de38a60d459b67770c90d24484dbc92cae not found: ID does not exist"
Jul 31 22:43:48.638461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.637353    2577 scope.go:117] "RemoveContainer" containerID="15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311"
Jul 31 22:43:48.649084 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.649062    2577 scope.go:117] "RemoveContainer" containerID="15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311"
Jul 31 22:43:48.649470 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:43:48.649448    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311\": container with ID starting with 15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311 not found: ID does not exist" containerID="15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311"
Jul 31 22:43:48.649560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.649482    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311"} err="failed to get container status \"15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311\": rpc error: code = NotFound desc = could not find container \"15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311\": container with ID starting with 15965f4d4485a7198b2851750f65774e7593a3c6e2846314f7c57d86e8d8f311 not found: ID does not exist"
Jul 31 22:43:48.649560 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.649505    2577 scope.go:117] "RemoveContainer" containerID="65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61"
Jul 31 22:43:48.650622 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.650605    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"]
Jul 31 22:43:48.655164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.655145    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-84098f-858db75d8d-p654h"]
Jul 31 22:43:48.658417 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.658400    2577 scope.go:117] "RemoveContainer" containerID="65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61"
Jul 31 22:43:48.658704 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:43:48.658681    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61\": container with ID starting with 65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61 not found: ID does not exist" containerID="65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61"
Jul 31 22:43:48.658772 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.658712    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61"} err="failed to get container status \"65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61\": rpc error: code = NotFound desc = could not find container \"65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61\": container with ID starting with 65d36ddcd1c41804be154686a8ddecb887130c26907c82a4042350ec0143ac61 not found: ID does not exist"
Jul 31 22:43:48.664477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.664456    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"]
Jul 31 22:43:48.668676 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.668642    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-84098f-54448ffc8c-fj2rp"]
Jul 31 22:43:48.678455 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.678435    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"]
Jul 31 22:43:48.678696 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.678677    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/24335777-013b-477c-99c3-c460b44510cc-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:48.678760 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.678702    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv8h9\" (UniqueName: \"kubernetes.io/projected/24335777-013b-477c-99c3-c460b44510cc-kube-api-access-rv8h9\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:43:48.682156 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:48.682133    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-84098f-5b7cd4f56-6nt7n"]
Jul 31 22:43:50.531952 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:50.531919    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24335777-013b-477c-99c3-c460b44510cc" path="/var/lib/kubelet/pods/24335777-013b-477c-99c3-c460b44510cc/volumes"
Jul 31 22:43:50.532373 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:50.532357    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7319475e-b2bc-443e-8bab-7c83b6f74fa1" path="/var/lib/kubelet/pods/7319475e-b2bc-443e-8bab-7c83b6f74fa1/volumes"
Jul 31 22:43:50.532705 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:50.532691    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1158b51-de88-4412-98e2-f048d2e1dc01" path="/var/lib/kubelet/pods/f1158b51-de88-4412-98e2-f048d2e1dc01/volumes"
Jul 31 22:43:59.275248 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275212    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"]
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275607    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a848c7f0-5b5b-4d2e-a00f-37e0a74ab796" containerName="payload-pre-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275619    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a848c7f0-5b5b-4d2e-a00f-37e0a74ab796" containerName="payload-pre-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275629    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7319475e-b2bc-443e-8bab-7c83b6f74fa1" containerName="maas-api"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275635    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7319475e-b2bc-443e-8bab-7c83b6f74fa1" containerName="maas-api"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275644    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92ae854e-e6dc-44da-b26f-40e5a100f212" containerName="payload-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275649    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="92ae854e-e6dc-44da-b26f-40e5a100f212" containerName="payload-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275661    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1158b51-de88-4412-98e2-f048d2e1dc01" containerName="payload-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275667    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1158b51-de88-4412-98e2-f048d2e1dc01" containerName="payload-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275674    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24335777-013b-477c-99c3-c460b44510cc" containerName="payload-pre-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275688    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="24335777-013b-477c-99c3-c460b44510cc" containerName="payload-pre-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275701    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="564113cc-add9-4515-b72b-d06317521565" containerName="maas-api"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275707    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="564113cc-add9-4515-b72b-d06317521565" containerName="maas-api"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275759    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="92ae854e-e6dc-44da-b26f-40e5a100f212" containerName="payload-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275767    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7319475e-b2bc-443e-8bab-7c83b6f74fa1" containerName="maas-api"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275772    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="564113cc-add9-4515-b72b-d06317521565" containerName="maas-api"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275779    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1158b51-de88-4412-98e2-f048d2e1dc01" containerName="payload-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275785    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="24335777-013b-477c-99c3-c460b44510cc" containerName="payload-pre-processing"
Jul 31 22:43:59.275859 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.275791    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a848c7f0-5b5b-4d2e-a00f-37e0a74ab796" containerName="payload-pre-processing"
Jul 31 22:43:59.280248 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.280228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.282419 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.282398    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-08271f-serving-cert\""
Jul 31 22:43:59.288142 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.287809    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"]
Jul 31 22:43:59.378328 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.378287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkt8k\" (UniqueName: \"kubernetes.io/projected/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-kube-api-access-pkt8k\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.378512 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.378375    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-maas-api-tls\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.378512 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.378399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.479349 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.479314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkt8k\" (UniqueName: \"kubernetes.io/projected/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-kube-api-access-pkt8k\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.479558 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.479366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-maas-api-tls\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.479558 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.479388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.479985 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.479964    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.481915 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.481892    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-maas-api-tls\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.486834 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.486804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkt8k\" (UniqueName: \"kubernetes.io/projected/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-kube-api-access-pkt8k\") pod \"maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.591739 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.591702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:43:59.741915 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.741890    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"]
Jul 31 22:43:59.743970 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:43:59.743947    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101b37ef_cfa9_4a2c_83be_0157e0b4bdeb.slice/crio-43b711f0957b3e3cbce7100f9605e7b32ac4fc3c5e04b0a8bdb0ebd25560836f WatchSource:0}: Error finding container 43b711f0957b3e3cbce7100f9605e7b32ac4fc3c5e04b0a8bdb0ebd25560836f: Status 404 returned error can't find the container with id 43b711f0957b3e3cbce7100f9605e7b32ac4fc3c5e04b0a8bdb0ebd25560836f
Jul 31 22:43:59.929710 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.929626    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"]
Jul 31 22:43:59.934412 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.934395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:43:59.936865 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.936837    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-08271f-dockercfg-7pqqp\""
Jul 31 22:43:59.937019 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.936868    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-08271f\""
Jul 31 22:43:59.943843 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.943819    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"]
Jul 31 22:43:59.964115 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.964085    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"]
Jul 31 22:43:59.967642 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.967621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:43:59.976505 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:43:59.976482    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"]
Jul 31 22:44:00.084381 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.084340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f48e0b60-dd69-4b64-acbd-63bc85debdb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx\" (UID: \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:00.084572 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.084450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqtpq\" (UniqueName: \"kubernetes.io/projected/f48e0b60-dd69-4b64-acbd-63bc85debdb5-kube-api-access-nqtpq\") pod \"payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx\" (UID: \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:00.084572 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.084542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92k9\" (UniqueName: \"kubernetes.io/projected/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-kube-api-access-k92k9\") pod \"payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc\" (UID: \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:00.084696 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.084591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc\" (UID: \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:00.185772 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.185704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqtpq\" (UniqueName: \"kubernetes.io/projected/f48e0b60-dd69-4b64-acbd-63bc85debdb5-kube-api-access-nqtpq\") pod \"payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx\" (UID: \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:00.185893 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.185857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92k9\" (UniqueName: \"kubernetes.io/projected/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-kube-api-access-k92k9\") pod \"payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc\" (UID: \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:00.185958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.185910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc\" (UID: \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:00.186026 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.185988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f48e0b60-dd69-4b64-acbd-63bc85debdb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx\" (UID: \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:00.186615 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.186594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc\" (UID: \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:00.186704 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.186688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f48e0b60-dd69-4b64-acbd-63bc85debdb5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx\" (UID: \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:00.193246 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.193224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92k9\" (UniqueName: \"kubernetes.io/projected/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-kube-api-access-k92k9\") pod \"payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc\" (UID: \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:00.193353 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.193311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqtpq\" (UniqueName: \"kubernetes.io/projected/f48e0b60-dd69-4b64-acbd-63bc85debdb5-kube-api-access-nqtpq\") pod \"payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx\" (UID: \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:00.246362 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.246326    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:00.278848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.278817    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:00.409755 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.409728    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"]
Jul 31 22:44:00.412977 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:44:00.412946    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48e0b60_dd69_4b64_acbd_63bc85debdb5.slice/crio-d5d41bc18909c4fefd246192acb178966db4b757a4088ab93dd8511acd409f5a WatchSource:0}: Error finding container d5d41bc18909c4fefd246192acb178966db4b757a4088ab93dd8511acd409f5a: Status 404 returned error can't find the container with id d5d41bc18909c4fefd246192acb178966db4b757a4088ab93dd8511acd409f5a
Jul 31 22:44:00.434604 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.434575    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"]
Jul 31 22:44:00.436559 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:44:00.436494    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63cb7e1_28b9_4a4a_9f8a_cbc2f772f8dd.slice/crio-29c6cbf9c06c9d0f62b9b917d8744dbf6c11cd95e9a0866edf5f9c8715f90c8a WatchSource:0}: Error finding container 29c6cbf9c06c9d0f62b9b917d8744dbf6c11cd95e9a0866edf5f9c8715f90c8a: Status 404 returned error can't find the container with id 29c6cbf9c06c9d0f62b9b917d8744dbf6c11cd95e9a0866edf5f9c8715f90c8a
Jul 31 22:44:00.704541 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.704447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc" event={"ID":"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd","Type":"ContainerStarted","Data":"5bd247a707e6c0521801b386335c55fc7eff12bffccc7c5de6cb00fa17bcea83"}
Jul 31 22:44:00.704541 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.704498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc" event={"ID":"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd","Type":"ContainerStarted","Data":"29c6cbf9c06c9d0f62b9b917d8744dbf6c11cd95e9a0866edf5f9c8715f90c8a"}
Jul 31 22:44:00.704541 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.704535    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:00.706089 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.706064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv" event={"ID":"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb","Type":"ContainerStarted","Data":"92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623"}
Jul 31 22:44:00.706255 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.706106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv" event={"ID":"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb","Type":"ContainerStarted","Data":"43b711f0957b3e3cbce7100f9605e7b32ac4fc3c5e04b0a8bdb0ebd25560836f"}
Jul 31 22:44:00.706255 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.706130    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:44:00.707536 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.707517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx" event={"ID":"f48e0b60-dd69-4b64-acbd-63bc85debdb5","Type":"ContainerStarted","Data":"4b3b41a334e176efd3ff5ac6770d429cd381769c6caef11d07fde537277a7950"}
Jul 31 22:44:00.707628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.707550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx" event={"ID":"f48e0b60-dd69-4b64-acbd-63bc85debdb5","Type":"ContainerStarted","Data":"d5d41bc18909c4fefd246192acb178966db4b757a4088ab93dd8511acd409f5a"}
Jul 31 22:44:00.707628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.707606    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:00.723413 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.723369    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc" podStartSLOduration=1.723353339 podStartE2EDuration="1.723353339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:44:00.721410908 +0000 UTC m=+2632.674497137" watchObservedRunningTime="2026-07-31 22:44:00.723353339 +0000 UTC m=+2632.676439568"
Jul 31 22:44:00.737216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.737140    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx" podStartSLOduration=1.737123786 podStartE2EDuration="1.737123786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:44:00.735371025 +0000 UTC m=+2632.688457255" watchObservedRunningTime="2026-07-31 22:44:00.737123786 +0000 UTC m=+2632.690210014"
Jul 31 22:44:00.753194 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:00.753120    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv" podStartSLOduration=1.385470956 podStartE2EDuration="1.753097641s" totalImagesPullingTime="367.626685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:44:00.750739544 +0000 UTC m=+2632.703825774" watchObservedRunningTime="2026-07-31 22:44:00.753097641 +0000 UTC m=+2632.706183873"
Jul 31 22:44:06.720580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:06.720553    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:44:11.717687 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:11.717653    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:44:11.718071 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:11.717816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:44:28.453036 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.452997    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"]
Jul 31 22:44:28.457081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.457060    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.459499 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.459475    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-3326ad-serving-cert\""
Jul 31 22:44:28.470919 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.470854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"]
Jul 31 22:44:28.550509 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.550474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.550683 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.550560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tp8r\" (UniqueName: \"kubernetes.io/projected/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-kube-api-access-7tp8r\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.550683 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.550614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-maas-api-tls\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.651239 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.651206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tp8r\" (UniqueName: \"kubernetes.io/projected/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-kube-api-access-7tp8r\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.651430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.651350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-maas-api-tls\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.651430 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.651377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.652103 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.652077    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.653937 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.653914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-maas-api-tls\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.659410 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.659387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tp8r\" (UniqueName: \"kubernetes.io/projected/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-kube-api-access-7tp8r\") pod \"maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.767731 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.767624    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:28.946965 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:28.946939    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"]
Jul 31 22:44:28.948994 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:44:28.948967    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b049e9_8ffc_431a_a57b_f7e8571eeffc.slice/crio-e5673ce7c76e6906c539cedbd23bcb43e828f576bfaa9e7ffde3557513d2b3fa WatchSource:0}: Error finding container e5673ce7c76e6906c539cedbd23bcb43e828f576bfaa9e7ffde3557513d2b3fa: Status 404 returned error can't find the container with id e5673ce7c76e6906c539cedbd23bcb43e828f576bfaa9e7ffde3557513d2b3fa
Jul 31 22:44:29.171325 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.171279    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"]
Jul 31 22:44:29.176038 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.176016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.181562 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.181534    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-3326ad-dockercfg-lwjpv\""
Jul 31 22:44:29.181706 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.181572    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-3326ad\""
Jul 31 22:44:29.195006 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.194977    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"]
Jul 31 22:44:29.216291 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.216258    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"]
Jul 31 22:44:29.220554 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.220529    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.229871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.229850    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"]
Jul 31 22:44:29.257641 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.257609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0244320e-3182-4a6c-aa96-f9e5d07bbe92-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk\" (UID: \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.257810 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.257719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4dsm\" (UniqueName: \"kubernetes.io/projected/0244320e-3182-4a6c-aa96-f9e5d07bbe92-kube-api-access-v4dsm\") pod \"payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk\" (UID: \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.359287 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.359259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fl7c\" (UniqueName: \"kubernetes.io/projected/320fe938-aef5-4d5c-9dac-98b7454a2ab9-kube-api-access-8fl7c\") pod \"payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst\" (UID: \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.359418 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.359380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0244320e-3182-4a6c-aa96-f9e5d07bbe92-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk\" (UID: \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.359470 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.359447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/320fe938-aef5-4d5c-9dac-98b7454a2ab9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst\" (UID: \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.359524 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.359485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4dsm\" (UniqueName: \"kubernetes.io/projected/0244320e-3182-4a6c-aa96-f9e5d07bbe92-kube-api-access-v4dsm\") pod \"payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk\" (UID: \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.360307 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.360278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0244320e-3182-4a6c-aa96-f9e5d07bbe92-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk\" (UID: \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.367696 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.367667    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4dsm\" (UniqueName: \"kubernetes.io/projected/0244320e-3182-4a6c-aa96-f9e5d07bbe92-kube-api-access-v4dsm\") pod \"payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk\" (UID: \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.460969 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.460861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/320fe938-aef5-4d5c-9dac-98b7454a2ab9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst\" (UID: \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.460969 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.460938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fl7c\" (UniqueName: \"kubernetes.io/projected/320fe938-aef5-4d5c-9dac-98b7454a2ab9-kube-api-access-8fl7c\") pod \"payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst\" (UID: \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.461862 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.461833    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/320fe938-aef5-4d5c-9dac-98b7454a2ab9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst\" (UID: \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.471165 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.471137    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fl7c\" (UniqueName: \"kubernetes.io/projected/320fe938-aef5-4d5c-9dac-98b7454a2ab9-kube-api-access-8fl7c\") pod \"payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst\" (UID: \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.486952 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.486927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.532545 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.532513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.639077 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.638600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"]
Jul 31 22:44:29.641042 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:44:29.641010    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0244320e_3182_4a6c_aa96_f9e5d07bbe92.slice/crio-7c27f53a6b57be55df00bb275536fe5a723ea350f11f0864fca4c06f645e0170 WatchSource:0}: Error finding container 7c27f53a6b57be55df00bb275536fe5a723ea350f11f0864fca4c06f645e0170: Status 404 returned error can't find the container with id 7c27f53a6b57be55df00bb275536fe5a723ea350f11f0864fca4c06f645e0170
Jul 31 22:44:29.693904 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.693838    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"]
Jul 31 22:44:29.696580 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:44:29.696554    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320fe938_aef5_4d5c_9dac_98b7454a2ab9.slice/crio-e6bc31da7a79724748a39c04e01de4071f700044c9e2df23626859fd604822b3 WatchSource:0}: Error finding container e6bc31da7a79724748a39c04e01de4071f700044c9e2df23626859fd604822b3: Status 404 returned error can't find the container with id e6bc31da7a79724748a39c04e01de4071f700044c9e2df23626859fd604822b3
Jul 31 22:44:29.868254 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.868215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst" event={"ID":"320fe938-aef5-4d5c-9dac-98b7454a2ab9","Type":"ContainerStarted","Data":"c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3"}
Jul 31 22:44:29.868524 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.868504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst" event={"ID":"320fe938-aef5-4d5c-9dac-98b7454a2ab9","Type":"ContainerStarted","Data":"e6bc31da7a79724748a39c04e01de4071f700044c9e2df23626859fd604822b3"}
Jul 31 22:44:29.868644 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.868632    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:29.870109 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.870065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk" event={"ID":"0244320e-3182-4a6c-aa96-f9e5d07bbe92","Type":"ContainerStarted","Data":"4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56"}
Jul 31 22:44:29.870263 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.870123    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk" event={"ID":"0244320e-3182-4a6c-aa96-f9e5d07bbe92","Type":"ContainerStarted","Data":"7c27f53a6b57be55df00bb275536fe5a723ea350f11f0864fca4c06f645e0170"}
Jul 31 22:44:29.870263 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.870150    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:44:29.872530 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.872472    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr" event={"ID":"c9b049e9-8ffc-431a-a57b-f7e8571eeffc","Type":"ContainerStarted","Data":"c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688"}
Jul 31 22:44:29.872530 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.872519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr" event={"ID":"c9b049e9-8ffc-431a-a57b-f7e8571eeffc","Type":"ContainerStarted","Data":"e5673ce7c76e6906c539cedbd23bcb43e828f576bfaa9e7ffde3557513d2b3fa"}
Jul 31 22:44:29.872781 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.872574    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:29.886076 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.886030    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst" podStartSLOduration=0.886015756 podStartE2EDuration="886.015756ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:44:29.883597655 +0000 UTC m=+2661.836683885" watchObservedRunningTime="2026-07-31 22:44:29.886015756 +0000 UTC m=+2661.839102040"
Jul 31 22:44:29.898313 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.898242    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk" podStartSLOduration=0.898227124 podStartE2EDuration="898.227124ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:44:29.897554642 +0000 UTC m=+2661.850640872" watchObservedRunningTime="2026-07-31 22:44:29.898227124 +0000 UTC m=+2661.851313353"
Jul 31 22:44:29.920685 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:29.915636    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr" podStartSLOduration=1.548650238 podStartE2EDuration="1.915619471s" totalImagesPullingTime="366.969233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:44:29.912424687 +0000 UTC m=+2661.865510916" watchObservedRunningTime="2026-07-31 22:44:29.915619471 +0000 UTC m=+2661.868705701"
Jul 31 22:44:35.883580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:35.883549    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:44:40.880214 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:40.880150    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:44:40.880660 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:44:40.880399    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:53:21.200798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.200758    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"]
Jul 31 22:53:21.204972 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.204950    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.207378 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.207355    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-56c69a-serving-cert\""
Jul 31 22:53:21.213259 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.213234    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"]
Jul 31 22:53:21.323752 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.323715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7a028d-92b3-47c0-b491-2a8454a714f2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.323962 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.323837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.323962 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.323867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnt6w\" (UniqueName: \"kubernetes.io/projected/9c7a028d-92b3-47c0-b491-2a8454a714f2-kube-api-access-bnt6w\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.424420 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.424373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7a028d-92b3-47c0-b491-2a8454a714f2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.424612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.424465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.424612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.424492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnt6w\" (UniqueName: \"kubernetes.io/projected/9c7a028d-92b3-47c0-b491-2a8454a714f2-kube-api-access-bnt6w\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.424699 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:53:21.424605    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-serving-cert: secret "maas-api-e2e-ipp-a-56c69a-serving-cert" not found
Jul 31 22:53:21.424699 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:53:21.424680    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls podName:9c7a028d-92b3-47c0-b491-2a8454a714f2 nodeName:}" failed. No retries permitted until 2026-07-31 22:53:21.92466408 +0000 UTC m=+3193.877750287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls") pod "maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg" (UID: "9c7a028d-92b3-47c0-b491-2a8454a714f2") : secret "maas-api-e2e-ipp-a-56c69a-serving-cert" not found
Jul 31 22:53:21.425050 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.425029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7a028d-92b3-47c0-b491-2a8454a714f2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.433576 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.433543    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnt6w\" (UniqueName: \"kubernetes.io/projected/9c7a028d-92b3-47c0-b491-2a8454a714f2-kube-api-access-bnt6w\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.859396 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.859359    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"]
Jul 31 22:53:21.863278 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.863249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:21.866581 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.866552    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-56c69a\""
Jul 31 22:53:21.874455 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.874430    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"]
Jul 31 22:53:21.877931 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.877913    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:21.883092 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.883066    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-56c69a-dockercfg-g4gc4\""
Jul 31 22:53:21.884090 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.884065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"]
Jul 31 22:53:21.895854 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.895825    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"]
Jul 31 22:53:21.931444 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.931404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1c10c2-4245-448a-8729-418075ea5618-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk\" (UID: \"3d1c10c2-4245-448a-8729-418075ea5618\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:21.931625 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.931458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zqdv\" (UniqueName: \"kubernetes.io/projected/6fda76e7-e7a7-428c-aaad-f769a929d08b-kube-api-access-6zqdv\") pod \"payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr\" (UID: \"6fda76e7-e7a7-428c-aaad-f769a929d08b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:21.931625 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.931490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fda76e7-e7a7-428c-aaad-f769a929d08b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr\" (UID: \"6fda76e7-e7a7-428c-aaad-f769a929d08b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:21.931625 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.931554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7hk9\" (UniqueName: \"kubernetes.io/projected/3d1c10c2-4245-448a-8729-418075ea5618-kube-api-access-w7hk9\") pod \"payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk\" (UID: \"3d1c10c2-4245-448a-8729-418075ea5618\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:21.931625 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.931594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:21.934016 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:21.933983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:22.032538 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.032498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hk9\" (UniqueName: \"kubernetes.io/projected/3d1c10c2-4245-448a-8729-418075ea5618-kube-api-access-w7hk9\") pod \"payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk\" (UID: \"3d1c10c2-4245-448a-8729-418075ea5618\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:22.032721 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.032565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1c10c2-4245-448a-8729-418075ea5618-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk\" (UID: \"3d1c10c2-4245-448a-8729-418075ea5618\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:22.032721 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.032592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqdv\" (UniqueName: \"kubernetes.io/projected/6fda76e7-e7a7-428c-aaad-f769a929d08b-kube-api-access-6zqdv\") pod \"payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr\" (UID: \"6fda76e7-e7a7-428c-aaad-f769a929d08b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:22.032721 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.032619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fda76e7-e7a7-428c-aaad-f769a929d08b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr\" (UID: \"6fda76e7-e7a7-428c-aaad-f769a929d08b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:22.033406 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.033387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fda76e7-e7a7-428c-aaad-f769a929d08b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr\" (UID: \"6fda76e7-e7a7-428c-aaad-f769a929d08b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:22.033452 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.033388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1c10c2-4245-448a-8729-418075ea5618-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk\" (UID: \"3d1c10c2-4245-448a-8729-418075ea5618\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:22.042316 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.042286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zqdv\" (UniqueName: \"kubernetes.io/projected/6fda76e7-e7a7-428c-aaad-f769a929d08b-kube-api-access-6zqdv\") pod \"payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr\" (UID: \"6fda76e7-e7a7-428c-aaad-f769a929d08b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:22.043880 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.043857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7hk9\" (UniqueName: \"kubernetes.io/projected/3d1c10c2-4245-448a-8729-418075ea5618-kube-api-access-w7hk9\") pod \"payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk\" (UID: \"3d1c10c2-4245-448a-8729-418075ea5618\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:22.116956 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.116867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:22.175116 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.175084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:22.190449 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.190030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:22.285359 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.285327    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"]
Jul 31 22:53:22.290505 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.290470    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:53:22.349886 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.349825    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"]
Jul 31 22:53:22.350290 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:53:22.350223    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1c10c2_4245_448a_8729_418075ea5618.slice/crio-df38750582dfcf9f833e688777377ebbcc4664fec963709b2d2b9bad7e3b4121 WatchSource:0}: Error finding container df38750582dfcf9f833e688777377ebbcc4664fec963709b2d2b9bad7e3b4121: Status 404 returned error can't find the container with id df38750582dfcf9f833e688777377ebbcc4664fec963709b2d2b9bad7e3b4121
Jul 31 22:53:22.377061 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.377039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"]
Jul 31 22:53:22.380359 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:53:22.380335    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fda76e7_e7a7_428c_aaad_f769a929d08b.slice/crio-f896479e8b0b9d02f2022333403ac55f30da70b27174b0e258b1442ac4a82df9 WatchSource:0}: Error finding container f896479e8b0b9d02f2022333403ac55f30da70b27174b0e258b1442ac4a82df9: Status 404 returned error can't find the container with id f896479e8b0b9d02f2022333403ac55f30da70b27174b0e258b1442ac4a82df9
Jul 31 22:53:22.823032 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.822987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg" event={"ID":"9c7a028d-92b3-47c0-b491-2a8454a714f2","Type":"ContainerStarted","Data":"433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10"}
Jul 31 22:53:22.823263 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.823050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg" event={"ID":"9c7a028d-92b3-47c0-b491-2a8454a714f2","Type":"ContainerStarted","Data":"de4174d5f2f1c5e97cc434eae095bd14554973330dea39e24f4fd1cdd5323dfc"}
Jul 31 22:53:22.823263 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.823078    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:22.824600 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.824568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr" event={"ID":"6fda76e7-e7a7-428c-aaad-f769a929d08b","Type":"ContainerStarted","Data":"76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d"}
Jul 31 22:53:22.824750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.824625    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:22.824750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.824649    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr" event={"ID":"6fda76e7-e7a7-428c-aaad-f769a929d08b","Type":"ContainerStarted","Data":"f896479e8b0b9d02f2022333403ac55f30da70b27174b0e258b1442ac4a82df9"}
Jul 31 22:53:22.826019 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.825998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk" event={"ID":"3d1c10c2-4245-448a-8729-418075ea5618","Type":"ContainerStarted","Data":"0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d"}
Jul 31 22:53:22.826134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.826037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk" event={"ID":"3d1c10c2-4245-448a-8729-418075ea5618","Type":"ContainerStarted","Data":"df38750582dfcf9f833e688777377ebbcc4664fec963709b2d2b9bad7e3b4121"}
Jul 31 22:53:22.826134 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.826090    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:22.844457 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.844402    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg" podStartSLOduration=1.443233036 podStartE2EDuration="1.844385491s" totalImagesPullingTime="401.152455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:53:22.841245176 +0000 UTC m=+3194.794331401" watchObservedRunningTime="2026-07-31 22:53:22.844385491 +0000 UTC m=+3194.797471719"
Jul 31 22:53:22.857910 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.857847    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk" podStartSLOduration=1.8578275 podStartE2EDuration="1.8578275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:53:22.857533786 +0000 UTC m=+3194.810620017" watchObservedRunningTime="2026-07-31 22:53:22.8578275 +0000 UTC m=+3194.810913734"
Jul 31 22:53:22.875858 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:22.875804    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr" podStartSLOduration=1.875789857 podStartE2EDuration="1.875789857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:53:22.874550441 +0000 UTC m=+3194.827636672" watchObservedRunningTime="2026-07-31 22:53:22.875789857 +0000 UTC m=+3194.828876086"
Jul 31 22:53:28.839158 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:28.839122    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:53:33.835517 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:33.835473    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:53:33.835978 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:33.835649    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:53:50.209314 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.209275    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"]
Jul 31 22:53:50.214471 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.214448    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.230201 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.230163    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-918fe5-serving-cert\""
Jul 31 22:53:50.240601 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.240566    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"]
Jul 31 22:53:50.302915 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.302883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cs7p\" (UniqueName: \"kubernetes.io/projected/4615085a-7fe7-4a22-9490-d5b858e96cbc-kube-api-access-2cs7p\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.303104 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.302921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.303104 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.303012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615085a-7fe7-4a22-9490-d5b858e96cbc-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.404577 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.404526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615085a-7fe7-4a22-9490-d5b858e96cbc-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.404760 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.404651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cs7p\" (UniqueName: \"kubernetes.io/projected/4615085a-7fe7-4a22-9490-d5b858e96cbc-kube-api-access-2cs7p\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.404760 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.404677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.404841 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:53:50.404803    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-serving-cert: secret "maas-api-e2e-ipp-b-918fe5-serving-cert" not found
Jul 31 22:53:50.404886 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:53:50.404875    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls podName:4615085a-7fe7-4a22-9490-d5b858e96cbc nodeName:}" failed. No retries permitted until 2026-07-31 22:53:50.904857056 +0000 UTC m=+3222.857943264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls") pod "maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4" (UID: "4615085a-7fe7-4a22-9490-d5b858e96cbc") : secret "maas-api-e2e-ipp-b-918fe5-serving-cert" not found
Jul 31 22:53:50.405270 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.405251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615085a-7fe7-4a22-9490-d5b858e96cbc-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.416050 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.416015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cs7p\" (UniqueName: \"kubernetes.io/projected/4615085a-7fe7-4a22-9490-d5b858e96cbc-kube-api-access-2cs7p\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.911318 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.911279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:50.913683 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:50.913652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls\") pod \"maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:51.126225 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.126191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:51.309351 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:53:51.309312    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4615085a_7fe7_4a22_9490_d5b858e96cbc.slice/crio-4c2cdd07e3a1dccafd8a58eb8debe3979ff7aa83743fd43107bc4386cd52df94 WatchSource:0}: Error finding container 4c2cdd07e3a1dccafd8a58eb8debe3979ff7aa83743fd43107bc4386cd52df94: Status 404 returned error can't find the container with id 4c2cdd07e3a1dccafd8a58eb8debe3979ff7aa83743fd43107bc4386cd52df94
Jul 31 22:53:51.319716 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.319689    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"]
Jul 31 22:53:51.354140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.354104    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"]
Jul 31 22:53:51.359065 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.359048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:51.364350 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.364326    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-918fe5\""
Jul 31 22:53:51.364628 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.364610    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-918fe5-dockercfg-8nlxv\""
Jul 31 22:53:51.376072 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.376043    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"]
Jul 31 22:53:51.416666 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.416634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trwx2\" (UniqueName: \"kubernetes.io/projected/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-kube-api-access-trwx2\") pod \"payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld\" (UID: \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:51.416834 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.416695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld\" (UID: \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:51.517706 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.517610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trwx2\" (UniqueName: \"kubernetes.io/projected/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-kube-api-access-trwx2\") pod \"payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld\" (UID: \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:51.517706 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.517677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld\" (UID: \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:51.518437 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.518418    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld\" (UID: \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:51.526610 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.526577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trwx2\" (UniqueName: \"kubernetes.io/projected/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-kube-api-access-trwx2\") pod \"payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld\" (UID: \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:51.671065 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.671027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:51.814003 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:51.813969    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"]
Jul 31 22:53:51.815211 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:53:51.815170    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7eb98d_7e0e_420f_a151_8456ad7ef9e8.slice/crio-e7e222949c70c6af9124c44ea8b31abe46872eb39179170160d36d79ae2263a1 WatchSource:0}: Error finding container e7e222949c70c6af9124c44ea8b31abe46872eb39179170160d36d79ae2263a1: Status 404 returned error can't find the container with id e7e222949c70c6af9124c44ea8b31abe46872eb39179170160d36d79ae2263a1
Jul 31 22:53:52.008580 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:52.008540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld" event={"ID":"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8","Type":"ContainerStarted","Data":"7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676"}
Jul 31 22:53:52.008786 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:52.008633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld" event={"ID":"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8","Type":"ContainerStarted","Data":"e7e222949c70c6af9124c44ea8b31abe46872eb39179170160d36d79ae2263a1"}
Jul 31 22:53:52.008786 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:52.008660    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:53:52.010124 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:52.010097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4" event={"ID":"4615085a-7fe7-4a22-9490-d5b858e96cbc","Type":"ContainerStarted","Data":"e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0"}
Jul 31 22:53:52.010281 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:52.010138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4" event={"ID":"4615085a-7fe7-4a22-9490-d5b858e96cbc","Type":"ContainerStarted","Data":"4c2cdd07e3a1dccafd8a58eb8debe3979ff7aa83743fd43107bc4386cd52df94"}
Jul 31 22:53:52.010281 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:52.010233    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:53:52.032289 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:52.032244    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld" podStartSLOduration=1.032228086 podStartE2EDuration="1.032228086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:53:52.028144521 +0000 UTC m=+3223.981230750" watchObservedRunningTime="2026-07-31 22:53:52.032228086 +0000 UTC m=+3223.985314322"
Jul 31 22:53:52.049544 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:52.049479    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4" podStartSLOduration=1.786493798 podStartE2EDuration="2.049460153s" totalImagesPullingTime="262.966355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:53:52.04832368 +0000 UTC m=+3224.001409936" watchObservedRunningTime="2026-07-31 22:53:52.049460153 +0000 UTC m=+3224.002546388"
Jul 31 22:53:58.020976 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:53:58.020945    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:54:03.017920 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:54:03.017835    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:54:21.140518 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:54:21.140466    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pblgj_d04cdb1f-02eb-4f6f-8f28-2e98d2284f30/payload-processing/0.log"
Jul 31 22:55:06.155647 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:06.155613    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr_6fda76e7-e7a7-428c-aaad-f769a929d08b/payload-processing/0.log"
Jul 31 22:55:06.289908 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:06.289876    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pblgj_d04cdb1f-02eb-4f6f-8f28-2e98d2284f30/payload-processing/0.log"
Jul 31 22:55:11.541406 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.541301    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"]
Jul 31 22:55:11.545100 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.545082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.548435 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.548412    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-c5b030-serving-cert\""
Jul 31 22:55:11.556983 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.556952    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"]
Jul 31 22:55:11.609271 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.609232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8k2k\" (UniqueName: \"kubernetes.io/projected/8edf759f-fe3b-46e2-935a-fa558afc5d87-kube-api-access-w8k2k\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.609477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.609288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8edf759f-fe3b-46e2-935a-fa558afc5d87-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.609477 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.609351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8edf759f-fe3b-46e2-935a-fa558afc5d87-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.710635 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.710591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8k2k\" (UniqueName: \"kubernetes.io/projected/8edf759f-fe3b-46e2-935a-fa558afc5d87-kube-api-access-w8k2k\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.710847 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.710648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8edf759f-fe3b-46e2-935a-fa558afc5d87-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.710847 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.710679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8edf759f-fe3b-46e2-935a-fa558afc5d87-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.711356 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.711332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8edf759f-fe3b-46e2-935a-fa558afc5d87-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.713124 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.713101    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8edf759f-fe3b-46e2-935a-fa558afc5d87-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.725409 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.725385    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8k2k\" (UniqueName: \"kubernetes.io/projected/8edf759f-fe3b-46e2-935a-fa558afc5d87-kube-api-access-w8k2k\") pod \"maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:11.857243 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:11.857171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:12.005527 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:12.005499    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"]
Jul 31 22:55:12.007831 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:55:12.007804    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edf759f_fe3b_46e2_935a_fa558afc5d87.slice/crio-f356e45e7623f7bcd230e42aed882f1b01e1b7a43a34a8eaef4b96fdc6dc3647 WatchSource:0}: Error finding container f356e45e7623f7bcd230e42aed882f1b01e1b7a43a34a8eaef4b96fdc6dc3647: Status 404 returned error can't find the container with id f356e45e7623f7bcd230e42aed882f1b01e1b7a43a34a8eaef4b96fdc6dc3647
Jul 31 22:55:12.481164 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:12.481127    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr" event={"ID":"8edf759f-fe3b-46e2-935a-fa558afc5d87","Type":"ContainerStarted","Data":"f356e45e7623f7bcd230e42aed882f1b01e1b7a43a34a8eaef4b96fdc6dc3647"}
Jul 31 22:55:13.487978 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:13.487936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr" event={"ID":"8edf759f-fe3b-46e2-935a-fa558afc5d87","Type":"ContainerStarted","Data":"a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c"}
Jul 31 22:55:13.488422 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:13.488025    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:13.509907 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:13.509855    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr" podStartSLOduration=2.11195565 podStartE2EDuration="2.509840271s" totalImagesPullingTime="397.884621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:55:13.507325944 +0000 UTC m=+3305.460412173" watchObservedRunningTime="2026-07-31 22:55:13.509840271 +0000 UTC m=+3305.462926502"
Jul 31 22:55:19.500556 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:19.500523    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:42.368585 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.368494    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"]
Jul 31 22:55:42.369228 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.368781    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr" podUID="8edf759f-fe3b-46e2-935a-fa558afc5d87" containerName="maas-api" containerID="cri-o://a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c" gracePeriod=30
Jul 31 22:55:42.638633 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.638562    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:42.663804 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.663770    2577 generic.go:356] "Generic (PLEG): container finished" podID="8edf759f-fe3b-46e2-935a-fa558afc5d87" containerID="a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c" exitCode=0
Jul 31 22:55:42.663976 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.663825    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"
Jul 31 22:55:42.663976 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.663874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr" event={"ID":"8edf759f-fe3b-46e2-935a-fa558afc5d87","Type":"ContainerDied","Data":"a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c"}
Jul 31 22:55:42.663976 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.663940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr" event={"ID":"8edf759f-fe3b-46e2-935a-fa558afc5d87","Type":"ContainerDied","Data":"f356e45e7623f7bcd230e42aed882f1b01e1b7a43a34a8eaef4b96fdc6dc3647"}
Jul 31 22:55:42.663976 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.663970    2577 scope.go:117] "RemoveContainer" containerID="a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c"
Jul 31 22:55:42.675499 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.675481    2577 scope.go:117] "RemoveContainer" containerID="a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c"
Jul 31 22:55:42.675791 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:55:42.675772    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c\": container with ID starting with a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c not found: ID does not exist" containerID="a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c"
Jul 31 22:55:42.675840 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.675801    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c"} err="failed to get container status \"a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c\": rpc error: code = NotFound desc = could not find container \"a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c\": container with ID starting with a2ad6d5d7c7759e28ef8d97c70c2cc4df14dbd247a4c2b8d3fcc9c87c471e85c not found: ID does not exist"
Jul 31 22:55:42.725889 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.725857    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8k2k\" (UniqueName: \"kubernetes.io/projected/8edf759f-fe3b-46e2-935a-fa558afc5d87-kube-api-access-w8k2k\") pod \"8edf759f-fe3b-46e2-935a-fa558afc5d87\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") "
Jul 31 22:55:42.726055 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.725902    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8edf759f-fe3b-46e2-935a-fa558afc5d87-maas-api-tls\") pod \"8edf759f-fe3b-46e2-935a-fa558afc5d87\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") "
Jul 31 22:55:42.726055 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.726029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8edf759f-fe3b-46e2-935a-fa558afc5d87-openshift-service-ca\") pod \"8edf759f-fe3b-46e2-935a-fa558afc5d87\" (UID: \"8edf759f-fe3b-46e2-935a-fa558afc5d87\") "
Jul 31 22:55:42.726425 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.726402    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8edf759f-fe3b-46e2-935a-fa558afc5d87-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8edf759f-fe3b-46e2-935a-fa558afc5d87" (UID: "8edf759f-fe3b-46e2-935a-fa558afc5d87"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:55:42.728086 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.728066    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8edf759f-fe3b-46e2-935a-fa558afc5d87-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8edf759f-fe3b-46e2-935a-fa558afc5d87" (UID: "8edf759f-fe3b-46e2-935a-fa558afc5d87"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:55:42.728154 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.728105    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8edf759f-fe3b-46e2-935a-fa558afc5d87-kube-api-access-w8k2k" (OuterVolumeSpecName: "kube-api-access-w8k2k") pod "8edf759f-fe3b-46e2-935a-fa558afc5d87" (UID: "8edf759f-fe3b-46e2-935a-fa558afc5d87"). InnerVolumeSpecName "kube-api-access-w8k2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:55:42.827307 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.827261    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8k2k\" (UniqueName: \"kubernetes.io/projected/8edf759f-fe3b-46e2-935a-fa558afc5d87-kube-api-access-w8k2k\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:55:42.827307 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.827293    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8edf759f-fe3b-46e2-935a-fa558afc5d87-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:55:42.827307 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.827313    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8edf759f-fe3b-46e2-935a-fa558afc5d87-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:55:42.986743 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.986708    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"]
Jul 31 22:55:42.991566 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:42.991539    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c5b030-56f554bd96-srdxr"]
Jul 31 22:55:44.532436 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:55:44.532392    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8edf759f-fe3b-46e2-935a-fa558afc5d87" path="/var/lib/kubelet/pods/8edf759f-fe3b-46e2-935a-fa558afc5d87/volumes"
Jul 31 22:56:08.837721 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:08.837680    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"]
Jul 31 22:56:08.838254 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:08.837914    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg" podUID="9c7a028d-92b3-47c0-b491-2a8454a714f2" containerName="maas-api" containerID="cri-o://433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10" gracePeriod=30
Jul 31 22:56:08.897441 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:08.897398    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"]
Jul 31 22:56:08.897661 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:08.897613    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr" podUID="6fda76e7-e7a7-428c-aaad-f769a929d08b" containerName="payload-processing" containerID="cri-o://76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d" gracePeriod=30
Jul 31 22:56:08.906915 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:08.906886    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"]
Jul 31 22:56:08.907154 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:08.907132    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk" podUID="3d1c10c2-4245-448a-8729-418075ea5618" containerName="payload-pre-processing" containerID="cri-o://0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d" gracePeriod=30
Jul 31 22:56:09.197678 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.197651    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:56:09.212629 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.212604    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:56:09.223053 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.223028    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:56:09.290050 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.290017    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zqdv\" (UniqueName: \"kubernetes.io/projected/6fda76e7-e7a7-428c-aaad-f769a929d08b-kube-api-access-6zqdv\") pod \"6fda76e7-e7a7-428c-aaad-f769a929d08b\" (UID: \"6fda76e7-e7a7-428c-aaad-f769a929d08b\") "
Jul 31 22:56:09.290207 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.290077    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fda76e7-e7a7-428c-aaad-f769a929d08b-plugins-config-volume\") pod \"6fda76e7-e7a7-428c-aaad-f769a929d08b\" (UID: \"6fda76e7-e7a7-428c-aaad-f769a929d08b\") "
Jul 31 22:56:09.290497 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.290477    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fda76e7-e7a7-428c-aaad-f769a929d08b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6fda76e7-e7a7-428c-aaad-f769a929d08b" (UID: "6fda76e7-e7a7-428c-aaad-f769a929d08b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:56:09.292255 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.292152    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fda76e7-e7a7-428c-aaad-f769a929d08b-kube-api-access-6zqdv" (OuterVolumeSpecName: "kube-api-access-6zqdv") pod "6fda76e7-e7a7-428c-aaad-f769a929d08b" (UID: "6fda76e7-e7a7-428c-aaad-f769a929d08b"). InnerVolumeSpecName "kube-api-access-6zqdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:56:09.391735 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.391641    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1c10c2-4245-448a-8729-418075ea5618-plugins-config-volume\") pod \"3d1c10c2-4245-448a-8729-418075ea5618\" (UID: \"3d1c10c2-4245-448a-8729-418075ea5618\") "
Jul 31 22:56:09.391735 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.391701    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls\") pod \"9c7a028d-92b3-47c0-b491-2a8454a714f2\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") "
Jul 31 22:56:09.391953 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.391756    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7hk9\" (UniqueName: \"kubernetes.io/projected/3d1c10c2-4245-448a-8729-418075ea5618-kube-api-access-w7hk9\") pod \"3d1c10c2-4245-448a-8729-418075ea5618\" (UID: \"3d1c10c2-4245-448a-8729-418075ea5618\") "
Jul 31 22:56:09.391953 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.391778    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7a028d-92b3-47c0-b491-2a8454a714f2-openshift-service-ca\") pod \"9c7a028d-92b3-47c0-b491-2a8454a714f2\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") "
Jul 31 22:56:09.391953 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.391816    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnt6w\" (UniqueName: \"kubernetes.io/projected/9c7a028d-92b3-47c0-b491-2a8454a714f2-kube-api-access-bnt6w\") pod \"9c7a028d-92b3-47c0-b491-2a8454a714f2\" (UID: \"9c7a028d-92b3-47c0-b491-2a8454a714f2\") "
Jul 31 22:56:09.392124 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.392106    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zqdv\" (UniqueName: \"kubernetes.io/projected/6fda76e7-e7a7-428c-aaad-f769a929d08b-kube-api-access-6zqdv\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:56:09.392216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.392139    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fda76e7-e7a7-428c-aaad-f769a929d08b-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:56:09.392216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.392102    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1c10c2-4245-448a-8729-418075ea5618-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3d1c10c2-4245-448a-8729-418075ea5618" (UID: "3d1c10c2-4245-448a-8729-418075ea5618"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:56:09.392216 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.392162    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c7a028d-92b3-47c0-b491-2a8454a714f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c7a028d-92b3-47c0-b491-2a8454a714f2" (UID: "9c7a028d-92b3-47c0-b491-2a8454a714f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:56:09.394022 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.393998    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c7a028d-92b3-47c0-b491-2a8454a714f2" (UID: "9c7a028d-92b3-47c0-b491-2a8454a714f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:56:09.394111 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.394024    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1c10c2-4245-448a-8729-418075ea5618-kube-api-access-w7hk9" (OuterVolumeSpecName: "kube-api-access-w7hk9") pod "3d1c10c2-4245-448a-8729-418075ea5618" (UID: "3d1c10c2-4245-448a-8729-418075ea5618"). InnerVolumeSpecName "kube-api-access-w7hk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:56:09.394111 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.394080    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c7a028d-92b3-47c0-b491-2a8454a714f2-kube-api-access-bnt6w" (OuterVolumeSpecName: "kube-api-access-bnt6w") pod "9c7a028d-92b3-47c0-b491-2a8454a714f2" (UID: "9c7a028d-92b3-47c0-b491-2a8454a714f2"). InnerVolumeSpecName "kube-api-access-bnt6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:56:09.492617 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.492590    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7a028d-92b3-47c0-b491-2a8454a714f2-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:56:09.492617 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.492615    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7hk9\" (UniqueName: \"kubernetes.io/projected/3d1c10c2-4245-448a-8729-418075ea5618-kube-api-access-w7hk9\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:56:09.492617 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.492625    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7a028d-92b3-47c0-b491-2a8454a714f2-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:56:09.492853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.492634    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnt6w\" (UniqueName: \"kubernetes.io/projected/9c7a028d-92b3-47c0-b491-2a8454a714f2-kube-api-access-bnt6w\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:56:09.492853 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.492643    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d1c10c2-4245-448a-8729-418075ea5618-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:56:09.830261 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.830235    2577 generic.go:356] "Generic (PLEG): container finished" podID="6fda76e7-e7a7-428c-aaad-f769a929d08b" containerID="76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d" exitCode=0
Jul 31 22:56:09.830440 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.830279    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"
Jul 31 22:56:09.830440 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.830319    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr" event={"ID":"6fda76e7-e7a7-428c-aaad-f769a929d08b","Type":"ContainerDied","Data":"76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d"}
Jul 31 22:56:09.830440 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.830371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr" event={"ID":"6fda76e7-e7a7-428c-aaad-f769a929d08b","Type":"ContainerDied","Data":"f896479e8b0b9d02f2022333403ac55f30da70b27174b0e258b1442ac4a82df9"}
Jul 31 22:56:09.830440 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.830398    2577 scope.go:117] "RemoveContainer" containerID="76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d"
Jul 31 22:56:09.831839 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.831777    2577 generic.go:356] "Generic (PLEG): container finished" podID="3d1c10c2-4245-448a-8729-418075ea5618" containerID="0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d" exitCode=0
Jul 31 22:56:09.831839 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.831824    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"
Jul 31 22:56:09.832014 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.831862    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk" event={"ID":"3d1c10c2-4245-448a-8729-418075ea5618","Type":"ContainerDied","Data":"0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d"}
Jul 31 22:56:09.832014 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.831928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk" event={"ID":"3d1c10c2-4245-448a-8729-418075ea5618","Type":"ContainerDied","Data":"df38750582dfcf9f833e688777377ebbcc4664fec963709b2d2b9bad7e3b4121"}
Jul 31 22:56:09.833406 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.833378    2577 generic.go:356] "Generic (PLEG): container finished" podID="9c7a028d-92b3-47c0-b491-2a8454a714f2" containerID="433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10" exitCode=0
Jul 31 22:56:09.833521 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.833429    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"
Jul 31 22:56:09.833521 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.833422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg" event={"ID":"9c7a028d-92b3-47c0-b491-2a8454a714f2","Type":"ContainerDied","Data":"433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10"}
Jul 31 22:56:09.833633 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.833527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg" event={"ID":"9c7a028d-92b3-47c0-b491-2a8454a714f2","Type":"ContainerDied","Data":"de4174d5f2f1c5e97cc434eae095bd14554973330dea39e24f4fd1cdd5323dfc"}
Jul 31 22:56:09.841603 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.841384    2577 scope.go:117] "RemoveContainer" containerID="76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d"
Jul 31 22:56:09.841881 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:56:09.841688    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d\": container with ID starting with 76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d not found: ID does not exist" containerID="76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d"
Jul 31 22:56:09.841881 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.841728    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d"} err="failed to get container status \"76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d\": rpc error: code = NotFound desc = could not find container \"76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d\": container with ID starting with 76cdc7607d323aa38b705f94b22bf4f7c32c93d5a2c396e8dd4f16c75252e52d not found: ID does not exist"
Jul 31 22:56:09.841881 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.841752    2577 scope.go:117] "RemoveContainer" containerID="0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d"
Jul 31 22:56:09.858382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.858361    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"]
Jul 31 22:56:09.862561 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.862537    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-56c69a-6bd9885994-958qr"]
Jul 31 22:56:09.868450 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.868432    2577 scope.go:117] "RemoveContainer" containerID="0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d"
Jul 31 22:56:09.868775 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:56:09.868756    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d\": container with ID starting with 0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d not found: ID does not exist" containerID="0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d"
Jul 31 22:56:09.868856 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.868787    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d"} err="failed to get container status \"0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d\": rpc error: code = NotFound desc = could not find container \"0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d\": container with ID starting with 0f449edb1f8e132619086ab6c21d81f8ad60987348b18d438f549f56834cc41d not found: ID does not exist"
Jul 31 22:56:09.868856 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.868810    2577 scope.go:117] "RemoveContainer" containerID="433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10"
Jul 31 22:56:09.876129 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.876103    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"]
Jul 31 22:56:09.877646 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.877629    2577 scope.go:117] "RemoveContainer" containerID="433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10"
Jul 31 22:56:09.877891 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:56:09.877872    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10\": container with ID starting with 433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10 not found: ID does not exist" containerID="433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10"
Jul 31 22:56:09.877939 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.877909    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10"} err="failed to get container status \"433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10\": rpc error: code = NotFound desc = could not find container \"433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10\": container with ID starting with 433881c634384e4b6fd8fedc3c9d09a3021f6ddaabb932853493b4a3ab29ac10 not found: ID does not exist"
Jul 31 22:56:09.883123 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.883103    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-56c69a-5b946d6768-jcdpg"]
Jul 31 22:56:09.901893 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.901866    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"]
Jul 31 22:56:09.905991 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:09.905970    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-56c69a-845bccd6bd-d4hfk"]
Jul 31 22:56:10.532308 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:10.532274    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d1c10c2-4245-448a-8729-418075ea5618" path="/var/lib/kubelet/pods/3d1c10c2-4245-448a-8729-418075ea5618/volumes"
Jul 31 22:56:10.532651 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:10.532638    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fda76e7-e7a7-428c-aaad-f769a929d08b" path="/var/lib/kubelet/pods/6fda76e7-e7a7-428c-aaad-f769a929d08b/volumes"
Jul 31 22:56:10.532984 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:56:10.532973    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c7a028d-92b3-47c0-b491-2a8454a714f2" path="/var/lib/kubelet/pods/9c7a028d-92b3-47c0-b491-2a8454a714f2/volumes"
Jul 31 22:57:14.773717 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:14.773680    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"]
Jul 31 22:57:14.774268 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:14.773939    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4" podUID="4615085a-7fe7-4a22-9490-d5b858e96cbc" containerName="maas-api" containerID="cri-o://e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0" gracePeriod=30
Jul 31 22:57:14.859625 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:14.859590    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"]
Jul 31 22:57:14.859903 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:14.859851    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld" podUID="9f7eb98d-7e0e-420f-a151-8456ad7ef9e8" containerName="payload-pre-processing" containerID="cri-o://7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676" gracePeriod=30
Jul 31 22:57:15.124616 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.124586    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:57:15.159228 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.159203    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:57:15.222423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.222390    2577 generic.go:356] "Generic (PLEG): container finished" podID="9f7eb98d-7e0e-420f-a151-8456ad7ef9e8" containerID="7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676" exitCode=0
Jul 31 22:57:15.222612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.222437    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"
Jul 31 22:57:15.222612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.222473    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld" event={"ID":"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8","Type":"ContainerDied","Data":"7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676"}
Jul 31 22:57:15.222612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.222520    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld" event={"ID":"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8","Type":"ContainerDied","Data":"e7e222949c70c6af9124c44ea8b31abe46872eb39179170160d36d79ae2263a1"}
Jul 31 22:57:15.222612 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.222550    2577 scope.go:117] "RemoveContainer" containerID="7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676"
Jul 31 22:57:15.223871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.223850    2577 generic.go:356] "Generic (PLEG): container finished" podID="4615085a-7fe7-4a22-9490-d5b858e96cbc" containerID="e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0" exitCode=0
Jul 31 22:57:15.223970 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.223892    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"
Jul 31 22:57:15.223970 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.223940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4" event={"ID":"4615085a-7fe7-4a22-9490-d5b858e96cbc","Type":"ContainerDied","Data":"e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0"}
Jul 31 22:57:15.224055 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.223984    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4" event={"ID":"4615085a-7fe7-4a22-9490-d5b858e96cbc","Type":"ContainerDied","Data":"4c2cdd07e3a1dccafd8a58eb8debe3979ff7aa83743fd43107bc4386cd52df94"}
Jul 31 22:57:15.231303 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.231279    2577 scope.go:117] "RemoveContainer" containerID="7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676"
Jul 31 22:57:15.231588 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:57:15.231567    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676\": container with ID starting with 7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676 not found: ID does not exist" containerID="7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676"
Jul 31 22:57:15.231637 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.231599    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676"} err="failed to get container status \"7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676\": rpc error: code = NotFound desc = could not find container \"7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676\": container with ID starting with 7ea0f3284ee8cc999d9c4c25fd20b9e67e11c9d078f51efa9c055028c4290676 not found: ID does not exist"
Jul 31 22:57:15.231637 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.231616    2577 scope.go:117] "RemoveContainer" containerID="e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0"
Jul 31 22:57:15.240502 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.240480    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cs7p\" (UniqueName: \"kubernetes.io/projected/4615085a-7fe7-4a22-9490-d5b858e96cbc-kube-api-access-2cs7p\") pod \"4615085a-7fe7-4a22-9490-d5b858e96cbc\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") "
Jul 31 22:57:15.240618 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.240513    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615085a-7fe7-4a22-9490-d5b858e96cbc-openshift-service-ca\") pod \"4615085a-7fe7-4a22-9490-d5b858e96cbc\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") "
Jul 31 22:57:15.240618 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.240537    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls\") pod \"4615085a-7fe7-4a22-9490-d5b858e96cbc\" (UID: \"4615085a-7fe7-4a22-9490-d5b858e96cbc\") "
Jul 31 22:57:15.241031 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.241005    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4615085a-7fe7-4a22-9490-d5b858e96cbc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4615085a-7fe7-4a22-9490-d5b858e96cbc" (UID: "4615085a-7fe7-4a22-9490-d5b858e96cbc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:15.242024 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.242002    2577 scope.go:117] "RemoveContainer" containerID="e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0"
Jul 31 22:57:15.242392 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:57:15.242365    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0\": container with ID starting with e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0 not found: ID does not exist" containerID="e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0"
Jul 31 22:57:15.242487 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.242399    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0"} err="failed to get container status \"e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0\": rpc error: code = NotFound desc = could not find container \"e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0\": container with ID starting with e46e3b7826d83d1ce63616e5cd3895cfe0c23f3a4ffb1c630ba4910c9d68fba0 not found: ID does not exist"
Jul 31 22:57:15.242761 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.242740    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4615085a-7fe7-4a22-9490-d5b858e96cbc-kube-api-access-2cs7p" (OuterVolumeSpecName: "kube-api-access-2cs7p") pod "4615085a-7fe7-4a22-9490-d5b858e96cbc" (UID: "4615085a-7fe7-4a22-9490-d5b858e96cbc"). InnerVolumeSpecName "kube-api-access-2cs7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:15.242812 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.242753    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4615085a-7fe7-4a22-9490-d5b858e96cbc" (UID: "4615085a-7fe7-4a22-9490-d5b858e96cbc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:57:15.341043 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.341015    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trwx2\" (UniqueName: \"kubernetes.io/projected/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-kube-api-access-trwx2\") pod \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\" (UID: \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\") "
Jul 31 22:57:15.341239 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.341085    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-plugins-config-volume\") pod \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\" (UID: \"9f7eb98d-7e0e-420f-a151-8456ad7ef9e8\") "
Jul 31 22:57:15.341344 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.341331    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cs7p\" (UniqueName: \"kubernetes.io/projected/4615085a-7fe7-4a22-9490-d5b858e96cbc-kube-api-access-2cs7p\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:15.341382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.341348    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4615085a-7fe7-4a22-9490-d5b858e96cbc-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:15.341382 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.341356    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4615085a-7fe7-4a22-9490-d5b858e96cbc-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:15.341505 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.341482    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f7eb98d-7e0e-420f-a151-8456ad7ef9e8" (UID: "9f7eb98d-7e0e-420f-a151-8456ad7ef9e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:15.343160 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.343141    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-kube-api-access-trwx2" (OuterVolumeSpecName: "kube-api-access-trwx2") pod "9f7eb98d-7e0e-420f-a151-8456ad7ef9e8" (UID: "9f7eb98d-7e0e-420f-a151-8456ad7ef9e8"). InnerVolumeSpecName "kube-api-access-trwx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:15.442066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.442034    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trwx2\" (UniqueName: \"kubernetes.io/projected/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-kube-api-access-trwx2\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:15.442066 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.442059    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:15.561426 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.561395    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"]
Jul 31 22:57:15.567564 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.567539    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-918fe5-65d8b99f7c-d5mb4"]
Jul 31 22:57:15.603109 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.603032    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"]
Jul 31 22:57:15.605702 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:15.605686    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-918fe5-8667d686f6-jf7ld"]
Jul 31 22:57:16.533749 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:16.533715    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4615085a-7fe7-4a22-9490-d5b858e96cbc" path="/var/lib/kubelet/pods/4615085a-7fe7-4a22-9490-d5b858e96cbc/volumes"
Jul 31 22:57:16.541572 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:16.534563    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7eb98d-7e0e-420f-a151-8456ad7ef9e8" path="/var/lib/kubelet/pods/9f7eb98d-7e0e-420f-a151-8456ad7ef9e8/volumes"
Jul 31 22:57:32.997967 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:32.997930    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"]
Jul 31 22:57:32.998798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:32.998749    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv" podUID="101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" containerName="maas-api" containerID="cri-o://92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623" gracePeriod=30
Jul 31 22:57:33.059634 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.059600    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"]
Jul 31 22:57:33.059848 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.059822    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc" podUID="d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd" containerName="payload-processing" containerID="cri-o://5bd247a707e6c0521801b386335c55fc7eff12bffccc7c5de6cb00fa17bcea83" gracePeriod=30
Jul 31 22:57:33.076162 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.076128    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"]
Jul 31 22:57:33.076413 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.076387    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx" podUID="f48e0b60-dd69-4b64-acbd-63bc85debdb5" containerName="payload-pre-processing" containerID="cri-o://4b3b41a334e176efd3ff5ac6770d429cd381769c6caef11d07fde537277a7950" gracePeriod=30
Jul 31 22:57:33.336466 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.336434    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:57:33.338040 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.338006    2577 generic.go:356] "Generic (PLEG): container finished" podID="d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd" containerID="5bd247a707e6c0521801b386335c55fc7eff12bffccc7c5de6cb00fa17bcea83" exitCode=0
Jul 31 22:57:33.338156 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.338089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc" event={"ID":"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd","Type":"ContainerDied","Data":"5bd247a707e6c0521801b386335c55fc7eff12bffccc7c5de6cb00fa17bcea83"}
Jul 31 22:57:33.339680 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.339652    2577 generic.go:356] "Generic (PLEG): container finished" podID="101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" containerID="92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623" exitCode=0
Jul 31 22:57:33.339793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.339682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv" event={"ID":"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb","Type":"ContainerDied","Data":"92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623"}
Jul 31 22:57:33.339793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.339709    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"
Jul 31 22:57:33.339793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.339745    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv" event={"ID":"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb","Type":"ContainerDied","Data":"43b711f0957b3e3cbce7100f9605e7b32ac4fc3c5e04b0a8bdb0ebd25560836f"}
Jul 31 22:57:33.339793 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.339775    2577 scope.go:117] "RemoveContainer" containerID="92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623"
Jul 31 22:57:33.341645 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.341619    2577 generic.go:356] "Generic (PLEG): container finished" podID="f48e0b60-dd69-4b64-acbd-63bc85debdb5" containerID="4b3b41a334e176efd3ff5ac6770d429cd381769c6caef11d07fde537277a7950" exitCode=0
Jul 31 22:57:33.341750 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.341657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx" event={"ID":"f48e0b60-dd69-4b64-acbd-63bc85debdb5","Type":"ContainerDied","Data":"4b3b41a334e176efd3ff5ac6770d429cd381769c6caef11d07fde537277a7950"}
Jul 31 22:57:33.349140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.349119    2577 scope.go:117] "RemoveContainer" containerID="92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623"
Jul 31 22:57:33.349454 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:57:33.349436    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623\": container with ID starting with 92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623 not found: ID does not exist" containerID="92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623"
Jul 31 22:57:33.349539 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.349472    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623"} err="failed to get container status \"92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623\": rpc error: code = NotFound desc = could not find container \"92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623\": container with ID starting with 92d94a9e0451da37cc5dd42f56b87c62a04c728b04cba131795754c61d200623 not found: ID does not exist"
Jul 31 22:57:33.378767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.378738    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:57:33.394213 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.394190    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:57:33.397226 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.397202    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-openshift-service-ca\") pod \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") "
Jul 31 22:57:33.397379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.397256    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkt8k\" (UniqueName: \"kubernetes.io/projected/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-kube-api-access-pkt8k\") pod \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") "
Jul 31 22:57:33.397379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.397298    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-maas-api-tls\") pod \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\" (UID: \"101b37ef-cfa9-4a2c-83be-0157e0b4bdeb\") "
Jul 31 22:57:33.397379 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.397328    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k92k9\" (UniqueName: \"kubernetes.io/projected/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-kube-api-access-k92k9\") pod \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\" (UID: \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\") "
Jul 31 22:57:33.397604 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.397382    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-plugins-config-volume\") pod \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\" (UID: \"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd\") "
Jul 31 22:57:33.397604 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.397531    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" (UID: "101b37ef-cfa9-4a2c-83be-0157e0b4bdeb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:33.398284 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.398238    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:33.398284 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.398251    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd" (UID: "d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:33.400291 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.400242    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-kube-api-access-pkt8k" (OuterVolumeSpecName: "kube-api-access-pkt8k") pod "101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" (UID: "101b37ef-cfa9-4a2c-83be-0157e0b4bdeb"). InnerVolumeSpecName "kube-api-access-pkt8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:33.400584 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.400560    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-kube-api-access-k92k9" (OuterVolumeSpecName: "kube-api-access-k92k9") pod "d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd" (UID: "d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd"). InnerVolumeSpecName "kube-api-access-k92k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:33.400584 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.400576    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" (UID: "101b37ef-cfa9-4a2c-83be-0157e0b4bdeb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:57:33.499559 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.499528    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f48e0b60-dd69-4b64-acbd-63bc85debdb5-plugins-config-volume\") pod \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\" (UID: \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\") "
Jul 31 22:57:33.499743 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.499599    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqtpq\" (UniqueName: \"kubernetes.io/projected/f48e0b60-dd69-4b64-acbd-63bc85debdb5-kube-api-access-nqtpq\") pod \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\" (UID: \"f48e0b60-dd69-4b64-acbd-63bc85debdb5\") "
Jul 31 22:57:33.499789 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.499778    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkt8k\" (UniqueName: \"kubernetes.io/projected/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-kube-api-access-pkt8k\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:33.499825 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.499788    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:33.499825 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.499798    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k92k9\" (UniqueName: \"kubernetes.io/projected/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-kube-api-access-k92k9\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:33.499825 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.499806    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:33.500018 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.499986    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f48e0b60-dd69-4b64-acbd-63bc85debdb5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f48e0b60-dd69-4b64-acbd-63bc85debdb5" (UID: "f48e0b60-dd69-4b64-acbd-63bc85debdb5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:33.501639 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.501620    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f48e0b60-dd69-4b64-acbd-63bc85debdb5-kube-api-access-nqtpq" (OuterVolumeSpecName: "kube-api-access-nqtpq") pod "f48e0b60-dd69-4b64-acbd-63bc85debdb5" (UID: "f48e0b60-dd69-4b64-acbd-63bc85debdb5"). InnerVolumeSpecName "kube-api-access-nqtpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:33.601131 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.601099    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqtpq\" (UniqueName: \"kubernetes.io/projected/f48e0b60-dd69-4b64-acbd-63bc85debdb5-kube-api-access-nqtpq\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:33.601131 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.601127    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f48e0b60-dd69-4b64-acbd-63bc85debdb5-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:33.662798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.662761    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"]
Jul 31 22:57:33.669926 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:33.669897    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08271f-8c5bfc8bb-rwltv"]
Jul 31 22:57:34.348762 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.348731    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"
Jul 31 22:57:34.348762 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.348758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc" event={"ID":"d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd","Type":"ContainerDied","Data":"29c6cbf9c06c9d0f62b9b917d8744dbf6c11cd95e9a0866edf5f9c8715f90c8a"}
Jul 31 22:57:34.349330 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.348813    2577 scope.go:117] "RemoveContainer" containerID="5bd247a707e6c0521801b386335c55fc7eff12bffccc7c5de6cb00fa17bcea83"
Jul 31 22:57:34.351124 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.351103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx" event={"ID":"f48e0b60-dd69-4b64-acbd-63bc85debdb5","Type":"ContainerDied","Data":"d5d41bc18909c4fefd246192acb178966db4b757a4088ab93dd8511acd409f5a"}
Jul 31 22:57:34.351124 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.351120    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"
Jul 31 22:57:34.361112 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.360983    2577 scope.go:117] "RemoveContainer" containerID="4b3b41a334e176efd3ff5ac6770d429cd381769c6caef11d07fde537277a7950"
Jul 31 22:57:34.379505 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.379479    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"]
Jul 31 22:57:34.386998 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.386977    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-08271f-8fd84874-nd9tc"]
Jul 31 22:57:34.396973 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.396933    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"]
Jul 31 22:57:34.399262 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.399243    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-08271f-57dcf85cd8-m9bwx"]
Jul 31 22:57:34.532634 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.532600    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" path="/var/lib/kubelet/pods/101b37ef-cfa9-4a2c-83be-0157e0b4bdeb/volumes"
Jul 31 22:57:34.532961 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.532948    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd" path="/var/lib/kubelet/pods/d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd/volumes"
Jul 31 22:57:34.533291 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:34.533279    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48e0b60-dd69-4b64-acbd-63bc85debdb5" path="/var/lib/kubelet/pods/f48e0b60-dd69-4b64-acbd-63bc85debdb5/volumes"
Jul 31 22:57:51.027897 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.027851    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"]
Jul 31 22:57:51.028515 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.028098    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr" podUID="c9b049e9-8ffc-431a-a57b-f7e8571eeffc" containerName="maas-api" containerID="cri-o://c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688" gracePeriod=30
Jul 31 22:57:51.092944 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.092905    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"]
Jul 31 22:57:51.093159 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.093117    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst" podUID="320fe938-aef5-4d5c-9dac-98b7454a2ab9" containerName="payload-processing" containerID="cri-o://c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3" gracePeriod=30
Jul 31 22:57:51.098640 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.098606    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"]
Jul 31 22:57:51.098876 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.098852    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk" podUID="0244320e-3182-4a6c-aa96-f9e5d07bbe92" containerName="payload-pre-processing" containerID="cri-o://4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56" gracePeriod=30
Jul 31 22:57:51.353003 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.352975    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:57:51.356593 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.356567    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:57:51.391919 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.391894    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:57:51.448835 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.448800    2577 generic.go:356] "Generic (PLEG): container finished" podID="320fe938-aef5-4d5c-9dac-98b7454a2ab9" containerID="c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3" exitCode=0
Jul 31 22:57:51.449037 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.448842    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"
Jul 31 22:57:51.449037 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.448882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst" event={"ID":"320fe938-aef5-4d5c-9dac-98b7454a2ab9","Type":"ContainerDied","Data":"c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3"}
Jul 31 22:57:51.449037 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.448944    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst" event={"ID":"320fe938-aef5-4d5c-9dac-98b7454a2ab9","Type":"ContainerDied","Data":"e6bc31da7a79724748a39c04e01de4071f700044c9e2df23626859fd604822b3"}
Jul 31 22:57:51.449037 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.448973    2577 scope.go:117] "RemoveContainer" containerID="c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3"
Jul 31 22:57:51.450241 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.450223    2577 generic.go:356] "Generic (PLEG): container finished" podID="0244320e-3182-4a6c-aa96-f9e5d07bbe92" containerID="4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56" exitCode=0
Jul 31 22:57:51.450339 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.450263    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"
Jul 31 22:57:51.450339 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.450293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk" event={"ID":"0244320e-3182-4a6c-aa96-f9e5d07bbe92","Type":"ContainerDied","Data":"4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56"}
Jul 31 22:57:51.450471 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.450349    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk" event={"ID":"0244320e-3182-4a6c-aa96-f9e5d07bbe92","Type":"ContainerDied","Data":"7c27f53a6b57be55df00bb275536fe5a723ea350f11f0864fca4c06f645e0170"}
Jul 31 22:57:51.451767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.451745    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9b049e9-8ffc-431a-a57b-f7e8571eeffc" containerID="c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688" exitCode=0
Jul 31 22:57:51.451855 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.451772    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr" event={"ID":"c9b049e9-8ffc-431a-a57b-f7e8571eeffc","Type":"ContainerDied","Data":"c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688"}
Jul 31 22:57:51.451855 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.451791    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"
Jul 31 22:57:51.451855 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.451818    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr" event={"ID":"c9b049e9-8ffc-431a-a57b-f7e8571eeffc","Type":"ContainerDied","Data":"e5673ce7c76e6906c539cedbd23bcb43e828f576bfaa9e7ffde3557513d2b3fa"}
Jul 31 22:57:51.458236 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.458212    2577 scope.go:117] "RemoveContainer" containerID="c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3"
Jul 31 22:57:51.458506 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:57:51.458485    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3\": container with ID starting with c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3 not found: ID does not exist" containerID="c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3"
Jul 31 22:57:51.458582 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.458515    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3"} err="failed to get container status \"c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3\": rpc error: code = NotFound desc = could not find container \"c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3\": container with ID starting with c79f9dc04797adcf2e48f72017ba7e9c8416cfad18848a715f96258540c2d4e3 not found: ID does not exist"
Jul 31 22:57:51.458582 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.458533    2577 scope.go:117] "RemoveContainer" containerID="4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56"
Jul 31 22:57:51.466429 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.466414    2577 scope.go:117] "RemoveContainer" containerID="4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56"
Jul 31 22:57:51.466659 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:57:51.466639    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56\": container with ID starting with 4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56 not found: ID does not exist" containerID="4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56"
Jul 31 22:57:51.466706 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.466672    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56"} err="failed to get container status \"4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56\": rpc error: code = NotFound desc = could not find container \"4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56\": container with ID starting with 4b414a28c8b366bb4e20ea1105547a0771534105ee7cd6b0dff65980b75e9f56 not found: ID does not exist"
Jul 31 22:57:51.466706 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.466688    2577 scope.go:117] "RemoveContainer" containerID="c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688"
Jul 31 22:57:51.471070 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471048    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fl7c\" (UniqueName: \"kubernetes.io/projected/320fe938-aef5-4d5c-9dac-98b7454a2ab9-kube-api-access-8fl7c\") pod \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\" (UID: \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\") "
Jul 31 22:57:51.471157 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471103    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0244320e-3182-4a6c-aa96-f9e5d07bbe92-plugins-config-volume\") pod \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\" (UID: \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\") "
Jul 31 22:57:51.471157 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471132    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-maas-api-tls\") pod \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") "
Jul 31 22:57:51.471157 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471153    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4dsm\" (UniqueName: \"kubernetes.io/projected/0244320e-3182-4a6c-aa96-f9e5d07bbe92-kube-api-access-v4dsm\") pod \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\" (UID: \"0244320e-3182-4a6c-aa96-f9e5d07bbe92\") "
Jul 31 22:57:51.471364 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471209    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-openshift-service-ca\") pod \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") "
Jul 31 22:57:51.471364 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471233    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/320fe938-aef5-4d5c-9dac-98b7454a2ab9-plugins-config-volume\") pod \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\" (UID: \"320fe938-aef5-4d5c-9dac-98b7454a2ab9\") "
Jul 31 22:57:51.471364 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471260    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tp8r\" (UniqueName: \"kubernetes.io/projected/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-kube-api-access-7tp8r\") pod \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\" (UID: \"c9b049e9-8ffc-431a-a57b-f7e8571eeffc\") "
Jul 31 22:57:51.471608 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471585    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0244320e-3182-4a6c-aa96-f9e5d07bbe92-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0244320e-3182-4a6c-aa96-f9e5d07bbe92" (UID: "0244320e-3182-4a6c-aa96-f9e5d07bbe92"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:51.471680 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471626    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c9b049e9-8ffc-431a-a57b-f7e8571eeffc" (UID: "c9b049e9-8ffc-431a-a57b-f7e8571eeffc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:51.471761 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.471734    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/320fe938-aef5-4d5c-9dac-98b7454a2ab9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "320fe938-aef5-4d5c-9dac-98b7454a2ab9" (UID: "320fe938-aef5-4d5c-9dac-98b7454a2ab9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:51.473305 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.473279    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0244320e-3182-4a6c-aa96-f9e5d07bbe92-kube-api-access-v4dsm" (OuterVolumeSpecName: "kube-api-access-v4dsm") pod "0244320e-3182-4a6c-aa96-f9e5d07bbe92" (UID: "0244320e-3182-4a6c-aa96-f9e5d07bbe92"). InnerVolumeSpecName "kube-api-access-v4dsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:51.473461 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.473437    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-kube-api-access-7tp8r" (OuterVolumeSpecName: "kube-api-access-7tp8r") pod "c9b049e9-8ffc-431a-a57b-f7e8571eeffc" (UID: "c9b049e9-8ffc-431a-a57b-f7e8571eeffc"). InnerVolumeSpecName "kube-api-access-7tp8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:51.473632 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.473616    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320fe938-aef5-4d5c-9dac-98b7454a2ab9-kube-api-access-8fl7c" (OuterVolumeSpecName: "kube-api-access-8fl7c") pod "320fe938-aef5-4d5c-9dac-98b7454a2ab9" (UID: "320fe938-aef5-4d5c-9dac-98b7454a2ab9"). InnerVolumeSpecName "kube-api-access-8fl7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:51.473697 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.473637    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c9b049e9-8ffc-431a-a57b-f7e8571eeffc" (UID: "c9b049e9-8ffc-431a-a57b-f7e8571eeffc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:57:51.475537 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.475521    2577 scope.go:117] "RemoveContainer" containerID="c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688"
Jul 31 22:57:51.475828 ip-10-0-139-36 kubenswrapper[2577]: E0731 22:57:51.475807    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688\": container with ID starting with c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688 not found: ID does not exist" containerID="c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688"
Jul 31 22:57:51.475871 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.475838    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688"} err="failed to get container status \"c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688\": rpc error: code = NotFound desc = could not find container \"c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688\": container with ID starting with c7dbe9d454e0754f2887251f1b6ba3c23c8c80699304596a85a984b510ea2688 not found: ID does not exist"
Jul 31 22:57:51.572767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.572679    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-openshift-service-ca\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:51.572767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.572711    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/320fe938-aef5-4d5c-9dac-98b7454a2ab9-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:51.572767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.572720    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tp8r\" (UniqueName: \"kubernetes.io/projected/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-kube-api-access-7tp8r\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:51.572767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.572729    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fl7c\" (UniqueName: \"kubernetes.io/projected/320fe938-aef5-4d5c-9dac-98b7454a2ab9-kube-api-access-8fl7c\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:51.572767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.572738    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0244320e-3182-4a6c-aa96-f9e5d07bbe92-plugins-config-volume\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:51.572767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.572747    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c9b049e9-8ffc-431a-a57b-f7e8571eeffc-maas-api-tls\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:51.572767 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.572755    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4dsm\" (UniqueName: \"kubernetes.io/projected/0244320e-3182-4a6c-aa96-f9e5d07bbe92-kube-api-access-v4dsm\") on node \"ip-10-0-139-36.ec2.internal\" DevicePath \"\""
Jul 31 22:57:51.780041 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.780011    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"]
Jul 31 22:57:51.787002 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.786961    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-3326ad-868d5784f8-zczst"]
Jul 31 22:57:51.804400 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.804367    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"]
Jul 31 22:57:51.810832 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.810809    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-3326ad-555fd68d68-cbshk"]
Jul 31 22:57:51.829199 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.829105    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"]
Jul 31 22:57:51.836081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:51.836054    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-3326ad-57fc5665b6-qpgvr"]
Jul 31 22:57:52.532932 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:52.532893    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0244320e-3182-4a6c-aa96-f9e5d07bbe92" path="/var/lib/kubelet/pods/0244320e-3182-4a6c-aa96-f9e5d07bbe92/volumes"
Jul 31 22:57:52.533346 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:52.533286    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="320fe938-aef5-4d5c-9dac-98b7454a2ab9" path="/var/lib/kubelet/pods/320fe938-aef5-4d5c-9dac-98b7454a2ab9/volumes"
Jul 31 22:57:52.533640 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:57:52.533626    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9b049e9-8ffc-431a-a57b-f7e8571eeffc" path="/var/lib/kubelet/pods/c9b049e9-8ffc-431a-a57b-f7e8571eeffc/volumes"
Jul 31 22:58:05.354909 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:05.354879    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75c94bd444-jlhl9_ee406bb6-2c6b-4162-804f-e36f8884eaba/manager/0.log"
Jul 31 22:58:05.604099 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:05.604069    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gtp5r_c2d75910-92f9-407a-9560-693a69510cc7/manager/0.log"
Jul 31 22:58:05.853947 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:05.853919    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79bdc6db47-nhxt7_cdde1527-5446-484a-9efc-26377a8c4a89/copy-manifests/0.log"
Jul 31 22:58:05.866958 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:05.866921    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79bdc6db47-nhxt7_cdde1527-5446-484a-9efc-26377a8c4a89/manager/0.log"
Jul 31 22:58:06.375207 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:06.375168    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d7bfcf6cd-t5w5t_e31e9ab2-ff68-448b-bff8-254920621125/maas-api/0.log"
Jul 31 22:58:06.857590 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:06.857562    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5d6c6_35a2c71b-bd9a-4f45-ae72-faa7a45aa4b6/postgres/0.log"
Jul 31 22:58:08.951729 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:08.951697    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sj95h_02c807ac-6653-4e86-9f9c-2409c5b8ed9e/discovery/0.log"
Jul 31 22:58:09.444278 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:09.444247    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-hm4n5_9689d533-05e6-4a5d-9d01-356c7c005b4f/payload-pre-processing/0.log"
Jul 31 22:58:09.566735 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:09.566706    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pblgj_d04cdb1f-02eb-4f6f-8f28-2e98d2284f30/payload-processing/0.log"
Jul 31 22:58:10.062868 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:10.062834    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gqs62_a9e63dc2-0762-4977-b967-e32638bdc61e/main/0.log"
Jul 31 22:58:10.182876 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:10.182839    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-xcpwj_5df2c586-5a58-4be2-8d1c-ebf969c3d265/main/0.log"
Jul 31 22:58:10.537838 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:10.537809    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-k5j6c_eeff90ca-b2e6-4c7f-b280-69713e697ff2/main/0.log"
Jul 31 22:58:19.224424 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:19.224388    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4wg9f_06942b15-d888-43d5-8cea-f897b295ef40/global-pull-secret-syncer/0.log"
Jul 31 22:58:19.356690 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:19.356659    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f6cwx_87a7ab77-269a-40cd-b07d-62c752cd4c8d/konnectivity-agent/0.log"
Jul 31 22:58:19.445627 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:19.445580    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-36.ec2.internal_ca97dff295e0b083931c560215aedbae/haproxy/0.log"
Jul 31 22:58:26.682352 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:26.682321    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bdd408ba-05bf-4175-800c-a77d5a9dd4c4/alertmanager/0.log"
Jul 31 22:58:26.715533 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:26.715504    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bdd408ba-05bf-4175-800c-a77d5a9dd4c4/config-reloader/0.log"
Jul 31 22:58:26.744724 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:26.744696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bdd408ba-05bf-4175-800c-a77d5a9dd4c4/kube-rbac-proxy-web/0.log"
Jul 31 22:58:26.770338 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:26.770308    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bdd408ba-05bf-4175-800c-a77d5a9dd4c4/kube-rbac-proxy/0.log"
Jul 31 22:58:26.799210 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:26.799162    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bdd408ba-05bf-4175-800c-a77d5a9dd4c4/kube-rbac-proxy-metric/0.log"
Jul 31 22:58:26.835950 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:26.835916    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bdd408ba-05bf-4175-800c-a77d5a9dd4c4/prom-label-proxy/0.log"
Jul 31 22:58:26.867142 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:26.867114    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bdd408ba-05bf-4175-800c-a77d5a9dd4c4/init-config-reloader/0.log"
Jul 31 22:58:27.064010 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:27.063886    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b8d5f4c47-vs8rd_b1a7bf62-c376-4e8d-84d3-25f98eeb5729/metrics-server/0.log"
Jul 31 22:58:27.132323 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:27.132294    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-5tjjb_ab9b9269-dfda-43b0-8c51-2830d8c3375b/monitoring-plugin/0.log"
Jul 31 22:58:27.272993 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:27.272950    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tvbm5_32c547b0-702f-49d5-81f2-c05352d1702a/node-exporter/0.log"
Jul 31 22:58:27.296395 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:27.296361    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tvbm5_32c547b0-702f-49d5-81f2-c05352d1702a/kube-rbac-proxy/0.log"
Jul 31 22:58:27.328075 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:27.328000    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tvbm5_32c547b0-702f-49d5-81f2-c05352d1702a/init-textfile/0.log"
Jul 31 22:58:27.462635 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:27.462611    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-nrjzd_f40099ec-1860-444b-a4f6-bda5fad32aca/kube-rbac-proxy-main/0.log"
Jul 31 22:58:27.498260 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:27.498227    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-nrjzd_f40099ec-1860-444b-a4f6-bda5fad32aca/kube-rbac-proxy-self/0.log"
Jul 31 22:58:27.529782 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:27.529756    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-nrjzd_f40099ec-1860-444b-a4f6-bda5fad32aca/openshift-state-metrics/0.log"
Jul 31 22:58:28.126798 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.126768    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8575889df8-mk6gk_7797041b-8451-45e0-bfc7-f4b51a59d585/telemeter-client/0.log"
Jul 31 22:58:28.167272 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.167246    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8575889df8-mk6gk_7797041b-8451-45e0-bfc7-f4b51a59d585/reload/0.log"
Jul 31 22:58:28.208445 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.208414    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8575889df8-mk6gk_7797041b-8451-45e0-bfc7-f4b51a59d585/kube-rbac-proxy/0.log"
Jul 31 22:58:28.244704 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.244677    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5494ff649f-pcvzn_cff824cd-204e-4e17-9c7d-ea2b7c999f6f/thanos-query/0.log"
Jul 31 22:58:28.285248 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.285221    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5494ff649f-pcvzn_cff824cd-204e-4e17-9c7d-ea2b7c999f6f/kube-rbac-proxy-web/0.log"
Jul 31 22:58:28.318402 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.318376    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5494ff649f-pcvzn_cff824cd-204e-4e17-9c7d-ea2b7c999f6f/kube-rbac-proxy/0.log"
Jul 31 22:58:28.354771 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.354742    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5494ff649f-pcvzn_cff824cd-204e-4e17-9c7d-ea2b7c999f6f/prom-label-proxy/0.log"
Jul 31 22:58:28.406343 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.406268    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5494ff649f-pcvzn_cff824cd-204e-4e17-9c7d-ea2b7c999f6f/kube-rbac-proxy-rules/0.log"
Jul 31 22:58:28.438768 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.438737    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5494ff649f-pcvzn_cff824cd-204e-4e17-9c7d-ea2b7c999f6f/kube-rbac-proxy-metrics/0.log"
Jul 31 22:58:28.762447 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762366    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"]
Jul 31 22:58:28.762749 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762737    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4615085a-7fe7-4a22-9490-d5b858e96cbc" containerName="maas-api"
Jul 31 22:58:28.762792 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762750    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4615085a-7fe7-4a22-9490-d5b858e96cbc" containerName="maas-api"
Jul 31 22:58:28.762792 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762760    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48e0b60-dd69-4b64-acbd-63bc85debdb5" containerName="payload-pre-processing"
Jul 31 22:58:28.762792 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762767    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48e0b60-dd69-4b64-acbd-63bc85debdb5" containerName="payload-pre-processing"
Jul 31 22:58:28.762792 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762777    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320fe938-aef5-4d5c-9dac-98b7454a2ab9" containerName="payload-processing"
Jul 31 22:58:28.762792 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762784    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="320fe938-aef5-4d5c-9dac-98b7454a2ab9" containerName="payload-processing"
Jul 31 22:58:28.762792 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762790    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fda76e7-e7a7-428c-aaad-f769a929d08b" containerName="payload-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762796    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fda76e7-e7a7-428c-aaad-f769a929d08b" containerName="payload-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762803    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0244320e-3182-4a6c-aa96-f9e5d07bbe92" containerName="payload-pre-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762809    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0244320e-3182-4a6c-aa96-f9e5d07bbe92" containerName="payload-pre-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762815    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8edf759f-fe3b-46e2-935a-fa558afc5d87" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762821    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8edf759f-fe3b-46e2-935a-fa558afc5d87" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762829    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9b049e9-8ffc-431a-a57b-f7e8571eeffc" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762834    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9b049e9-8ffc-431a-a57b-f7e8571eeffc" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762844    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1c10c2-4245-448a-8729-418075ea5618" containerName="payload-pre-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762849    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1c10c2-4245-448a-8729-418075ea5618" containerName="payload-pre-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762860    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762865    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762870    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c7a028d-92b3-47c0-b491-2a8454a714f2" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762875    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c7a028d-92b3-47c0-b491-2a8454a714f2" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762880    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd" containerName="payload-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762885    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd" containerName="payload-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762891    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7eb98d-7e0e-420f-a151-8456ad7ef9e8" containerName="payload-pre-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762897    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7eb98d-7e0e-420f-a151-8456ad7ef9e8" containerName="payload-pre-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762950    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fda76e7-e7a7-428c-aaad-f769a929d08b" containerName="payload-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762959    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d1c10c2-4245-448a-8729-418075ea5618" containerName="payload-pre-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762965    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c7a028d-92b3-47c0-b491-2a8454a714f2" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762971    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7eb98d-7e0e-420f-a151-8456ad7ef9e8" containerName="payload-pre-processing"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762978    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="101b37ef-cfa9-4a2c-83be-0157e0b4bdeb" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762983    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9b049e9-8ffc-431a-a57b-f7e8571eeffc" containerName="maas-api"
Jul 31 22:58:28.762979 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762988    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8edf759f-fe3b-46e2-935a-fa558afc5d87" containerName="maas-api"
Jul 31 22:58:28.763773 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762993    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63cb7e1-28b9-4a4a-9f8a-cbc2f772f8dd" containerName="payload-processing"
Jul 31 22:58:28.763773 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.762999    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="320fe938-aef5-4d5c-9dac-98b7454a2ab9" containerName="payload-processing"
Jul 31 22:58:28.763773 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.763005    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f48e0b60-dd69-4b64-acbd-63bc85debdb5" containerName="payload-pre-processing"
Jul 31 22:58:28.763773 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.763010    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4615085a-7fe7-4a22-9490-d5b858e96cbc" containerName="maas-api"
Jul 31 22:58:28.763773 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.763015    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0244320e-3182-4a6c-aa96-f9e5d07bbe92" containerName="payload-pre-processing"
Jul 31 22:58:28.766099 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.766084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.768779 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.768760    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rch42\"/\"kube-root-ca.crt\""
Jul 31 22:58:28.769118 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.769104    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rch42\"/\"openshift-service-ca.crt\""
Jul 31 22:58:28.769698 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.769684    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rch42\"/\"default-dockercfg-4qg57\""
Jul 31 22:58:28.779310 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.779279    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"]
Jul 31 22:58:28.803887 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.803858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-podres\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.804081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.803894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-sys\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.804081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.803915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-lib-modules\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.804081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.803939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-proc\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.804081 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.803992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ld7h\" (UniqueName: \"kubernetes.io/projected/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-kube-api-access-7ld7h\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.904986 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.904954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-podres\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.904986 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.904990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-sys\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.905275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.905009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-lib-modules\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.905275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.905037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-proc\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.905275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.905061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ld7h\" (UniqueName: \"kubernetes.io/projected/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-kube-api-access-7ld7h\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.905275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.905090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-sys\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.905275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.905112    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-proc\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.905275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.905139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-podres\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.905275 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.905144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-lib-modules\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:28.913825 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:28.913804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ld7h\" (UniqueName: \"kubernetes.io/projected/cdd37dd9-e434-4054-b3e9-572b8c2a52e1-kube-api-access-7ld7h\") pod \"perf-node-gather-daemonset-ktmph\" (UID: \"cdd37dd9-e434-4054-b3e9-572b8c2a52e1\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:29.075423 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:29.075330    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:29.213494 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:29.213464    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"]
Jul 31 22:58:29.214886 ip-10-0-139-36 kubenswrapper[2577]: W0731 22:58:29.214857    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcdd37dd9_e434_4054_b3e9_572b8c2a52e1.slice/crio-2e52ce86a04c7df447885f320e5fea99243558995430cd21cf5cabd8f3707042 WatchSource:0}: Error finding container 2e52ce86a04c7df447885f320e5fea99243558995430cd21cf5cabd8f3707042: Status 404 returned error can't find the container with id 2e52ce86a04c7df447885f320e5fea99243558995430cd21cf5cabd8f3707042
Jul 31 22:58:29.677762 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:29.677674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph" event={"ID":"cdd37dd9-e434-4054-b3e9-572b8c2a52e1","Type":"ContainerStarted","Data":"2398d5f39796875c541abbe7b532da2c924f74f72f2617d2649921d9bcffed75"}
Jul 31 22:58:29.677762 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:29.677725    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph" event={"ID":"cdd37dd9-e434-4054-b3e9-572b8c2a52e1","Type":"ContainerStarted","Data":"2e52ce86a04c7df447885f320e5fea99243558995430cd21cf5cabd8f3707042"}
Jul 31 22:58:29.677959 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:29.677764    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:29.699645 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:29.699584    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph" podStartSLOduration=1.6995682109999999 podStartE2EDuration="1.699568211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:58:29.698622635 +0000 UTC m=+3501.651708864" watchObservedRunningTime="2026-07-31 22:58:29.699568211 +0000 UTC m=+3501.652654440"
Jul 31 22:58:32.724913 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:32.724886    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qrftk_edce7d28-6289-4102-8fa4-73cdc5dac0f7/dns/0.log"
Jul 31 22:58:32.749822 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:32.749795    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qrftk_edce7d28-6289-4102-8fa4-73cdc5dac0f7/kube-rbac-proxy/0.log"
Jul 31 22:58:32.792920 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:32.792893    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8hhq5_0a6ab81a-9ae3-448c-afd3-0d3e7763b6c8/dns-node-resolver/0.log"
Jul 31 22:58:33.490459 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:33.490427    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-59z25_69cf9430-e7db-4f38-b18c-16a078c2a8e6/node-ca/0.log"
Jul 31 22:58:34.815608 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:34.815577    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sj95h_02c807ac-6653-4e86-9f9c-2409c5b8ed9e/discovery/0.log"
Jul 31 22:58:34.954803 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:34.954738    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-hm4n5_9689d533-05e6-4a5d-9d01-356c7c005b4f/payload-pre-processing/0.log"
Jul 31 22:58:34.989205 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:34.989150    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pblgj_d04cdb1f-02eb-4f6f-8f28-2e98d2284f30/payload-processing/0.log"
Jul 31 22:58:35.693048 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:35.693018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-ktmph"
Jul 31 22:58:35.907551 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:35.907524    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qzbqb_ee93c397-3f4a-4688-97ae-33f8f5be1d3a/serve-healthcheck-canary/0.log"
Jul 31 22:58:36.564927 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:36.564897    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6zjb_7e0435e4-3a55-4a9a-be11-18ae6a977ed8/kube-rbac-proxy/0.log"
Jul 31 22:58:36.587499 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:36.587474    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6zjb_7e0435e4-3a55-4a9a-be11-18ae6a977ed8/exporter/0.log"
Jul 31 22:58:36.610994 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:36.610970    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6zjb_7e0435e4-3a55-4a9a-be11-18ae6a977ed8/extractor/0.log"
Jul 31 22:58:39.488262 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:39.488228    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75c94bd444-jlhl9_ee406bb6-2c6b-4162-804f-e36f8884eaba/manager/0.log"
Jul 31 22:58:39.607292 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:39.607236    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sj95h_02c807ac-6653-4e86-9f9c-2409c5b8ed9e/discovery/0.log"
Jul 31 22:58:39.609141 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:39.609120    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gtp5r_c2d75910-92f9-407a-9560-693a69510cc7/manager/0.log"
Jul 31 22:58:39.685140 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:39.685108    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-hm4n5_9689d533-05e6-4a5d-9d01-356c7c005b4f/payload-pre-processing/0.log"
Jul 31 22:58:39.720425 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:39.720390    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pblgj_d04cdb1f-02eb-4f6f-8f28-2e98d2284f30/payload-processing/0.log"
Jul 31 22:58:39.773608 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:39.773521    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79bdc6db47-nhxt7_cdde1527-5446-484a-9efc-26377a8c4a89/manager/0.log"
Jul 31 22:58:39.846790 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:39.846762    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79bdc6db47-nhxt7_cdde1527-5446-484a-9efc-26377a8c4a89/copy-manifests/0.log"
Jul 31 22:58:41.308189 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:41.308159    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5587bd887b-6q245_0e8f6164-a7bf-47e8-b10b-bf532e47fe0b/manager/0.log"
Jul 31 22:58:41.375975 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:41.375937    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-sj95h_02c807ac-6653-4e86-9f9c-2409c5b8ed9e/discovery/0.log"
Jul 31 22:58:41.465142 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:41.465110    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-hm4n5_9689d533-05e6-4a5d-9d01-356c7c005b4f/payload-pre-processing/0.log"
Jul 31 22:58:41.487579 ip-10-0-139-36 kubenswrapper[2577]: I0731 22:58:41.487550    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-pblgj_d04cdb1f-02eb-4f6f-8f28-2e98d2284f30/payload-processing/0.log"